-- Logs begin at Thu 2022-09-15 13:28:22 UTC, end at Thu 2022-09-15 14:40:32 UTC. -- Sep 15 14:01:04.057304 dv-cinder-856971-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 14:01:04.066311 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 14:01:04 2022] *** Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: nodename: dv-cinder-856971-2-iscsi Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: machine: x86_64 Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: clock source: unix Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: pcre jit disabled Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: detected number of CPU cores: 4 Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: current working directory: / Sep 15 14:01:04.068528 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: detected binary path: /usr/bin/uwsgi-core Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: your processes number limit is 47680 Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: your memory page size is 4096 bytes Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: detected max file descriptor number: 2048 Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: lock engine: pthread robust mutexes Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: thunder lock: enabled Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 14:01:04.069270 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 14:01:04.108305 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: Python main interpreter initialized at 0x55ae4de0a9c0 Sep 15 14:01:04.108305 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: python threads support enabled Sep 15 14:01:04.108305 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: your server socket listen backlog is limited to 100 connections Sep 15 14:01:04.108305 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: your mercy for graceful operations on workers is 90 seconds Sep 15 14:01:04.108662 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 14:01:04.108743 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: *** Operational MODE: preforking *** Sep 15 14:01:04.108967 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: *** uWSGI is running in multiple interpreter mode *** Sep 15 14:01:04.108967 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: spawned uWSGI master process (pid: 105672) Sep 15 14:01:04.109160 dv-cinder-856971-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 14:01:04.110949 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: spawned uWSGI worker 1 (pid: 105673, cores: 1) Sep 15 14:01:04.110949 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: spawned uWSGI worker 2 (pid: 105674, cores: 1) Sep 15 14:01:04.110949 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 14:01:04.774886 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 14:01:04.777462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 14:01:05.864232 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:01:05.864232 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: from cryptography.utils import int_from_bytes Sep 15 14:01:05.864830 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:01:05.864830 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: from cryptography.utils import int_from_bytes Sep 15 14:01:05.866979 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:01:05.866979 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: from cryptography.utils import int_from_bytes Sep 15 14:01:05.867402 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:01:05.867402 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: from cryptography.utils import int_from_bytes Sep 15 14:01:08.350760 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 14:01:08.351218 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 14:01:08.351527 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 14:01:08.351920 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 14:01:08.352151 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 14:01:08.352523 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 14:01:08.352617 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 14:01:08.352699 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.352868 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.352974 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 14:01:08.353191 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.353299 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 14:01:08.353501 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 14:01:08.353605 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.353831 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.353928 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354142 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354245 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354473 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354617 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354789 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.354899 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355109 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355206 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355363 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355450 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355678 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.355812 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356022 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-2-iscsi {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356123 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356342 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356429 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356599 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356686 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356909 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.356994 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357228 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-2-iscsi {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357314 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357544 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357642 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357851 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.357935 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.358155 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.358246 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.358466 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.358662 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.358787 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.359074 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.359175 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.359379 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.359481 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.360266 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.360608 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.360703 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.360941 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361044 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361220 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361348 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361542 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361668 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361850 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.361984 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.362175 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.362301 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.362488 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.362631 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.362873 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363004 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-2-iscsi {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363306 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363491 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363614 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363825 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.363964 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-2-iscsi {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364352 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364531 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364657 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364839 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.364984 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365134 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365255 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365461 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365600 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365770 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.365897 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366092 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366234 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366408 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366549 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366723 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.366855 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367041 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367166 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367339 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367474 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367650 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367832 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.367971 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368094 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368292 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368431 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368584 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368710 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.368886 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369013 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369148 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369296 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369427 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369549 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369737 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.369878 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370046 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370180 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370303 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370431 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370579 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370706 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.370841 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371017 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371143 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371265 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371442 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371586 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371762 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.371901 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372040 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372164 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372316 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372443 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372633 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372760 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.372940 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373245 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373379 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373549 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373675 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373853 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.373978 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374157 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374285 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374461 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374587 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374764 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.374890 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.375069 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.375255 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376119 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376268 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376496 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376665 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376792 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.376997 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377126 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377312 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377438 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377633 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377760 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.377982 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378117 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378284 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378418 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378593 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378728 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.378906 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379031 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379213 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379340 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379522 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379662 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379866 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.379991 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.380187 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.380331 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.380491 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.380725 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.380871 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381003 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381137 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381270 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381392 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381515 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381635 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381755 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.381915 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382050 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382221 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382359 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382517 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382651 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382815 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.382950 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383121 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383246 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383426 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383562 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383751 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.383877 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384058 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384182 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384356 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384482 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384662 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384798 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.384965 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385133 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385259 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385448 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385584 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385758 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.385884 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386065 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386240 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386567 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386691 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386812 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.386956 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387080 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387259 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387399 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387563 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387734 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.387904 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388044 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388225 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388360 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388535 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388660 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388842 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.388986 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389148 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389285 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389453 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389585 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389768 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.389901 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390073 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390206 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390377 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390501 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390693 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.390919 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.391149 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.391285 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.391503 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.391661 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.391954 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392081 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392271 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392399 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392582 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392717 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.392889 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393016 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393186 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393312 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393491 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393623 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393797 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.393923 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394100 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394226 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394402 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394526 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394701 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.394826 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395004 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395133 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395306 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395432 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395608 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395763 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.395933 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396059 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396235 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396399 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396521 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396652 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396833 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.396968 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.397154 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.397281 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.397461 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.397596 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.397766 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.397893 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.398070 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.398205 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.398391 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:01:08.398532 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.398723 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.398849 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399053 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399181 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399368 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399501 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399706 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.399844 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400026 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400163 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400344 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400479 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400656 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400781 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.400966 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401091 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401280 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401408 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401601 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401734 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.401911 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402062 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402220 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402347 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402529 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402664 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402839 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.402965 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403155 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403280 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403480 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403612 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403823 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.403964 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404136 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404261 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404450 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404577 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404758 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.404894 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405076 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405210 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405400 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405534 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405717 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.405853 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406025 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406149 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406362 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406494 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406746 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.406913 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.407092 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.407294 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.407422 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.407621 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.407897 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408024 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408147 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408276 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408405 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408572 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408710 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.408883 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409016 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409222 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409357 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409536 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409677 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409848 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.409982 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410156 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410288 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410463 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410598 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410782 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.410918 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411095 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411222 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411401 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411541 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411728 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.411859 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412043 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412175 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412353 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412481 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412664 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412791 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.412980 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413121 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413287 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413414 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413592 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413727 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.413895 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414023 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414206 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414341 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414509 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414636 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414817 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.414962 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415130 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415258 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415432 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415559 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415744 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.415891 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416046 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416181 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416355 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416515 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416640 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416771 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.416960 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417087 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417263 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417387 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417576 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417720 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.417887 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418012 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418193 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418325 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418508 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418645 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418818 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.418950 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419123 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419252 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419422 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419541 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419754 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.419889 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420061 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420189 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420360 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420487 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420673 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420800 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.420980 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421106 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421284 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421412 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421592 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421724 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.421897 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.422571 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.422769 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.422898 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.423064 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.423408 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.423554 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.423756 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.423889 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424063 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424189 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424386 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424513 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424699 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.424826 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425015 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425148 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425320 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425454 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425629 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425756 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.425933 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426058 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426236 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426362 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426544 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426669 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426854 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.426956 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427156 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427275 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427461 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427558 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427785 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.427884 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428088 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428192 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428389 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428477 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428690 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428778 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.428999 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429109 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429302 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429396 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429604 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429751 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.429903 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430042 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430203 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430328 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430505 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430632 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430806 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.430933 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431124 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431249 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431429 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431562 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431768 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.431906 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432029 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432158 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432330 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432456 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432669 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432803 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.432973 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.433107 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.433308 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.433693 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.433876 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434010 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434193 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434325 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434504 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434629 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434813 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.434947 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435121 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435245 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435426 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435560 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435758 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.435886 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436069 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436204 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436375 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436509 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436676 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436802 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.436987 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.437119 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.437303 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.437510 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.437696 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.438352 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.438539 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.438701 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.438851 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439297 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439483 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439611 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439823 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.439961 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440141 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440269 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440456 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440583 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440776 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.440916 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441090 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441216 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441409 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441534 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441719 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.441852 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442032 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442157 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442340 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442464 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442649 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442782 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.442952 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443083 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443262 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443388 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443581 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443766 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.443916 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444042 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444233 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444357 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444539 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444672 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444858 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.444983 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445162 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445286 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445468 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445594 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445766 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.445892 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446069 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446374 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446502 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446688 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.446804 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447001 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447100 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447310 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447415 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447621 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447758 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.447948 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448060 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448254 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448342 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448562 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448650 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448865 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.448971 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449163 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449266 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449472 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449571 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449785 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.449948 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450095 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450248 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450384 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450524 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450678 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450824 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.450961 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451104 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451265 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451409 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451571 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451808 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.451953 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452090 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452240 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452377 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452522 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452676 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452815 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.452951 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.453093 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.453230 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.453484 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.453624 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.453769 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454041 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454227 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454371 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454556 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454710 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454860 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.454998 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455167 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455325 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455463 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455599 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455796 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.455954 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456100 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456252 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456417 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456561 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456727 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.456919 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457058 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457204 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457342 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457485 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457622 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457758 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.457931 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458086 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458250 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458394 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458559 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458717 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.458863 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459000 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459175 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459327 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459464 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459600 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459803 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.459951 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.460095 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.460232 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.460409 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.460679 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.460847 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461015 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461167 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461306 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461441 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461614 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461772 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.461910 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462047 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462193 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462345 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462505 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462649 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462805 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.462943 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.463216 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.463358 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.463522 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.463666 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.463886 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464025 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464169 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464362 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464503 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464714 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.464864 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465025 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465172 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465308 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465446 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465583 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465728 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.465872 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466009 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466160 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466298 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466458 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466612 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466760 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.466944 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467088 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467225 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467362 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467509 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467645 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.467873 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468020 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468166 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468310 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468456 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468595 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468742 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.468899 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469044 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469189 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469325 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469566 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469720 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.469880 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470024 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470225 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470374 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470533 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470678 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470834 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.470971 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471117 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471272 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471437 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471591 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471777 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.471924 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472073 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472219 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472357 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472493 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472657 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472821 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.472996 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473141 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473277 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473414 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473744 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.473891 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474029 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474187 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474344 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474483 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474639 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474786 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.474923 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475092 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475237 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475400 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475558 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475751 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.475898 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476036 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476172 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476359 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476502 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476660 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476798 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.476977 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477122 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477268 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477405 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477548 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477685 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477829 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.477967 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478112 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478250 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478394 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478542 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478679 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478815 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.478961 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479100 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479237 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479373 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479510 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479655 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479818 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.479956 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480094 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480240 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480387 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480536 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480734 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.480875 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481011 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481148 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481302 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481450 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481587 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481730 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.481875 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482013 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482164 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482311 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482449 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482586 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482723 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.482860 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483013 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483151 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483287 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483423 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483559 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483726 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.483884 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.484033 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.484170 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.484307 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.484442 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485101 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485380 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485535 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485696 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485840 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.485985 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486122 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486295 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486442 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486596 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486734 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.486878 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487071 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487216 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487352 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487496 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487633 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487804 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.487954 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488100 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488237 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488381 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488530 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488667 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488813 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.488959 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489097 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489233 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489369 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489571 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489725 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.489871 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490008 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490186 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490331 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490553 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490701 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490839 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.490984 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491120 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491256 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491401 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491537 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491729 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.491894 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492033 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492178 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492333 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492472 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492609 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492754 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.492899 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493037 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493190 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493336 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493498 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493643 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493781 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.493934 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494102 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494266 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494404 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494539 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494704 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.494863 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495001 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495137 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495301 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495445 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495608 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495791 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.495940 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496078 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496241 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496380 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496523 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496669 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496816 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.496954 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497131 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497276 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497412 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497558 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497717 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.497862 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498029 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498183 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498329 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498466 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498633 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498789 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.498929 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499064 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499238 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499383 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499528 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499670 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.499865 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500022 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500242 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500387 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500575 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500718 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.500931 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501169 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501326 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501471 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501609 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501753 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.501888 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502053 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502208 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502345 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502488 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502667 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502811 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.502979 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503126 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503270 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503420 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503592 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503790 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.503945 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504084 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504231 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504367 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504511 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504655 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504800 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.504937 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505094 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505239 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505383 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505638 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505807 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.505950 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506122 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506278 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506436 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506589 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506727 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.506870 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507038 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507225 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507370 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507519 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507657 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507835 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.507974 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508124 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508261 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508411 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508776 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.508950 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509101 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509247 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509392 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509572 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509715 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.509873 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510015 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510172 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510310 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510472 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510617 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510794 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.510971 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511129 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511267 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511410 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511580 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511759 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.511927 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512083 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512231 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512388 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512558 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512703 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512848 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.512985 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513146 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513296 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513441 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513579 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513766 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.513974 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514144 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514284 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514428 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514577 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514716 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.514884 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.515039 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.515204 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.515349 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.515525 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.515678 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.516418 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.516565 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.516897 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.516992 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.517315 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.517414 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.517640 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.517746 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.517957 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518047 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518281 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518371 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518597 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518693 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518903 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.518996 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519209 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519304 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519519 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519610 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519854 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.519946 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520162 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520252 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520496 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520587 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520798 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.520899 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521110 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521208 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521425 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521513 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521738 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.521825 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522044 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522141 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522349 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522438 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522674 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522761 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.522979 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523075 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523285 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523373 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523600 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523706 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.523948 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524051 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524274 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524450 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524608 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524755 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.524900 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525063 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525210 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525355 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525506 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525650 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525803 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.525947 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526090 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526234 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526378 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526521 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526675 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526819 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.526972 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527116 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527300 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527500 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527659 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527854 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.527999 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528149 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528299 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528442 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528603 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528748 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.528892 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529046 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529189 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529342 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529486 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529637 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529780 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.529924 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530067 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530256 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530402 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530545 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530689 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.530862 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531012 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531165 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531309 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531515 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531666 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.531858 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532152 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532312 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532458 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532601 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532752 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.532904 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533069 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533359 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533503 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533654 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533807 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.533961 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534106 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534249 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534392 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534544 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534688 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534841 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.534995 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535147 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535292 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535435 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535592 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535759 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.535910 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536086 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536237 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536402 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536565 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536718 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.536879 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537023 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537174 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537342 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537610 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537763 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.537906 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538050 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538193 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538347 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538501 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538647 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538792 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.538946 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539091 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539242 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539393 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539538 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539724 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.539879 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540024 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540179 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540325 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540468 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540643 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540796 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.540974 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.541287 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.541453 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.541607 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.541750 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.541903 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542056 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542209 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542353 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542502 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542647 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542790 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.542947 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543110 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543262 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543415 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543560 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543727 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.543963 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.544117 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.544293 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.544445 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.544591 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.544772 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545025 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545186 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545332 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545476 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545619 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545770 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.545915 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546059 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546203 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546346 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546496 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546654 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.546855 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.547593 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.547852 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548004 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548156 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548312 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548312 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548586 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548730 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.548874 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549037 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549189 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549335 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549497 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549649 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549793 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.549947 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550092 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550235 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550379 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550522 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550665 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550825 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.550971 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551116 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551269 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551414 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551567 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551729 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.551880 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552023 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552166 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552310 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552465 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552610 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552768 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.552913 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553066 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553357 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553510 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553665 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553811 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.553954 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554104 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554257 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554402 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554546 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554689 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.554862 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555021 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555189 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555344 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555494 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555640 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555832 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.555987 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556132 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556275 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556417 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556561 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556781 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.556940 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557095 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557239 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557383 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557526 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557719 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.557878 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.558023 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.558166 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.558316 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.558715 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.558868 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559022 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559296 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559461 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559606 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559777 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.559940 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560086 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560230 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560381 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560525 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560675 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560833 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.560978 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561122 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561265 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561419 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561569 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561723 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.561868 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.562012 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.562156 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.562307 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.562458 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.562855 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563022 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563307 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563458 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563626 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563854 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.563959 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564231 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564330 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564512 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564625 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564834 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.564926 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565141 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565229 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565558 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565766 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.565854 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566072 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566159 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566375 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566461 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566686 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566789 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.566995 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567095 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567295 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567392 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567598 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567769 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.567927 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568015 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568241 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568347 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568546 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568634 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568858 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.568946 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569165 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569268 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569479 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569567 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569780 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.569875 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570083 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570202 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570400 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570496 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570703 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.570794 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571005 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571103 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571309 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571399 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571615 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571818 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.571983 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572136 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572288 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572435 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572578 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572721 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.572878 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573024 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573175 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573319 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573463 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573617 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.573773 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574014 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574168 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574348 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574506 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574724 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.574897 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575042 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575186 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575338 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575484 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575637 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575848 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.575994 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576147 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576291 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576434 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576587 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576740 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.576885 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577029 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577179 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577331 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577484 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577627 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577782 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.577972 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.578117 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.578804 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.578963 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.579198 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.579363 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.579561 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.579834 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.580005 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.580360 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.580520 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.580764 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.580929 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581076 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581265 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581438 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581583 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581728 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.581889 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582043 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582188 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582340 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582498 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582655 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582800 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.582953 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583098 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583248 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583392 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583547 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583714 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.583879 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584025 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584169 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584320 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584464 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584621 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584775 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.584920 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585064 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585207 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585360 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585516 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585662 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585805 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.585949 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.586092 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.586421 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.586595 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.586748 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.586893 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587037 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587180 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587348 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587508 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587653 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.587838 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588023 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588187 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588340 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588485 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588639 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588783 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.588927 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589077 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589231 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589383 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589534 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589680 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589823 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.589980 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.590134 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.590308 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.590635 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.590793 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.590938 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591091 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591236 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591379 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591530 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591674 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.591847 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592003 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592148 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592303 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592464 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592610 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592754 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.592906 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593053 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593196 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593340 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593491 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593644 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.593795 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594031 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594327 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594480 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594641 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594793 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.594946 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595090 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595233 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595378 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595528 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595717 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.595889 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596035 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596186 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596337 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596482 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596650 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596803 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.596948 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597092 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597249 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597406 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597553 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597697 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597840 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.597983 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598175 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598330 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598475 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598630 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598775 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.598919 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599070 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599228 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599374 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599518 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599661 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599843 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.599991 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600100 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600223 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600336 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600450 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600662 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600802 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.600990 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601116 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601297 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601422 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601601 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601737 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.601905 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602032 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602208 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602334 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602511 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602647 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602811 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.602938 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603133 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603257 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603446 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603573 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603781 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.603911 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604094 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604231 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604429 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604554 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604706 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.604833 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605013 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605142 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605330 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605457 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605646 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605781 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.605957 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606083 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606263 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606390 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606575 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606699 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.606886 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607021 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607194 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607322 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607506 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607630 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607836 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.607976 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608141 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608270 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608438 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608565 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608754 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.608888 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.609068 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.609195 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.609370 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.609513 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.610259 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.610387 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.610656 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.610853 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.610980 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611188 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611325 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611509 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611636 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611859 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.611988 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.612270 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.612423 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.612615 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.612742 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.612927 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613061 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613245 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613374 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613559 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613694 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.613873 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614000 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614186 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614320 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614491 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614619 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.614741 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 14:01:08.614864 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.615106 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.615421 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.615768 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.616093 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.616403 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.616727 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.617051 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.617395 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.617711 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.618053 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.618378 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.618691 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.619004 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.619307 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:01:08.619549 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 14:01:08.768149 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO dbcounter [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Registered counter for database nova_api Sep 15 14:01:08.775148 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Registered counter for database nova_api Sep 15 14:01:08.788198 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_db.sqlalchemy.engines [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:08.794654 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writer thread running {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:08.795069 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:08.801675 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:08.851551 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.context [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),420e8343-b5ad-47f2-88fe-eb0072589000(cell1) {{(pid=105673) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 14:01:08.855372 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:01:08.855881 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:01:08.857441 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:01:08.858170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:01:08.858620 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:01:08.858731 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.context [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),420e8343-b5ad-47f2-88fe-eb0072589000(cell1) {{(pid=105674) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 14:01:08.860812 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:01:08.862799 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO dbcounter [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Registered counter for database nova_cell0 Sep 15 14:01:08.863061 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:01:08.863533 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:01:08.865348 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:01:08.865823 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:01:08.866266 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:01:08.866790 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO dbcounter [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Registered counter for database nova_cell1 Sep 15 14:01:08.868268 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_concurrency.lockutils [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:01:08.870230 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Registered counter for database nova_cell0 Sep 15 14:01:08.873992 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_db.sqlalchemy.engines [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:08.874270 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Registered counter for database nova_cell1 Sep 15 14:01:08.877300 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_db.sqlalchemy.engines [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:08.881661 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writer thread running {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:08.882076 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:08.886668 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:08.887314 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writer thread running {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:08.891593 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:09.030049 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO dbcounter [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Registered counter for database nova_cell0 Sep 15 14:01:09.031029 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:09.039018 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_db.sqlalchemy.engines [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:09.040675 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO dbcounter [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Registered counter for database nova_cell0 Sep 15 14:01:09.043815 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writer thread running {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:09.050186 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG oslo_db.sqlalchemy.engines [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:01:09.054912 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writer thread running {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:01:09.385278 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: WARNING keystonemiddleware.auth_token [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:01:09.390372 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:01:09.392829 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: WARNING keystonemiddleware.auth_token [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:01:09.398012 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:01:09.736978 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: WARNING keystonemiddleware.auth_token [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:01:09.742958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: WARNING keystonemiddleware.auth_token [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:01:09.746819 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:01:09.748295 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae4de0a9c0 pid: 105673 (default app) Sep 15 14:01:09.750484 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:01:09.751662 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001851 Sep 15 14:01:09.752103 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Sep 15 14:01:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:01:09.753117 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: WARNING keystonemiddleware.auth_token [None req-9248f621-5e2a-4265-9564-fe0c80ae793c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:01:09.758355 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae4de0a9c0 pid: 105674 (default app) Sep 15 14:02:31.050891 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:31.051959 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 15 14:02:31.052357 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:31.071734 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:31.073851 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell0:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:31.074861 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell1:SELECT=3 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:31.076058 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:31.966492 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-22ccc672-7259-4e54-b307-6843945621bf admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:31.998611 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-22ccc672-7259-4e54-b307-6843945621bf admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939138 Sep 15 14:02:31.999344 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 15 14:02:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:02:34.633725 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:34.634732 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-9748dad4-d5e8-4c85-91e9-9ddcb7888c99 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 15 14:02:34.635579 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:35.096483 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-88e61183-f4db-4f77-8105-5a962872306a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "ram": 256}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:35.144784 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-88e61183-f4db-4f77-8105-5a962872306a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502310 Sep 15 14:02:35.145661 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:35.159832 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_api:SELECT=3 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:35.160730 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_cell1:SELECT=3 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:35.162702 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_cell0:SELECT=3 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:35.164320 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:02:35.372863 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-5e2a5e9b-7b87-4fb5-acbb-7dd330d9630c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:35.445045 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-5e2a5e9b-7b87-4fb5-acbb-7dd330d9630c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291060 Sep 15 14:02:35.445638 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 15 14:02:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:38.075743 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-88e61183-f4db-4f77-8105-5a962872306a admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:38.077376 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-88e61183-f4db-4f77-8105-5a962872306a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Sep 15 14:02:38.077781 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:38.752061 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8016ab09-50e1-4e7f-ad0a-57a539dc894c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:38.791027 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-8016ab09-50e1-4e7f-ad0a-57a539dc894c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706568 Sep 15 14:02:38.791588 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:38.805814 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-ceacb011-571a-4a52-9062-8bacf31f1d53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:38.854145 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-ceacb011-571a-4a52-9062-8bacf31f1d53 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052866 Sep 15 14:02:38.854768 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 15 14:02:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:41.464509 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8016ab09-50e1-4e7f-ad0a-57a539dc894c admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:41.465571 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-8016ab09-50e1-4e7f-ad0a-57a539dc894c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 15 14:02:41.465997 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:41.879256 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-1e6a9083-f18f-449c-8303-b831fef7d742 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "swap": 0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:41.899762 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-1e6a9083-f18f-449c-8303-b831fef7d742 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426695 Sep 15 14:02:41.900240 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:41.913998 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-d7f5784e-7764-4fda-baa3-c21e5c70cd9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:41.945153 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-d7f5784e-7764-4fda-baa3-c21e5c70cd9f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035717 Sep 15 14:02:41.945724 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 15 14:02:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:44.713386 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-1e6a9083-f18f-449c-8303-b831fef7d742 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:44.714396 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-1e6a9083-f18f-449c-8303-b831fef7d742 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 15 14:02:44.714790 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:45.129486 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-b248100b-4a8f-43ca-82d4-ccc63bc3eb72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:45.152529 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-b248100b-4a8f-43ca-82d4-ccc63bc3eb72 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430390 Sep 15 14:02:45.153073 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 14:02:45.165680 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-dd79e289-e9e3-4912-8f2c-f1db1c0d883d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:45.194420 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-dd79e289-e9e3-4912-8f2c-f1db1c0d883d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032344 Sep 15 14:02:45.196229 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 15 14:02:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:47.888627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-b248100b-4a8f-43ca-82d4-ccc63bc3eb72 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:47.889571 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-b248100b-4a8f-43ca-82d4-ccc63bc3eb72 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 15 14:02:47.889978 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:48.298877 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:48.322505 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425874 Sep 15 14:02:48.323095 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:48.335939 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-eba2bdd9-f7e6-4f62-bd03-7260686312f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:48.360900 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-eba2bdd9-f7e6-4f62-bd03-7260686312f8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027941 Sep 15 14:02:48.361417 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 15 14:02:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:51.153753 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:51.154788 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 15 14:02:51.155179 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:51.581345 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-33f579a2-2910-4285-8a63-657d193268d2 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:51.606387 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-33f579a2-2910-4285-8a63-657d193268d2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444516 Sep 15 14:02:51.606855 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 15 14:02:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:02:54.242514 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:54.243524 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-5c335b9e-c484-4544-a67e-4685be72a6bf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 15 14:02:54.243970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:54.661809 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-26cf7dbd-b218-43ba-88c1-973024c0b6e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 512, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:54.682951 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-26cf7dbd-b218-43ba-88c1-973024c0b6e8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.432336 Sep 15 14:02:54.683551 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:54.697490 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-40f10fd8-d7b4-4048-adcb-9b9e6db6fd83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:54.727583 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-40f10fd8-d7b4-4048-adcb-9b9e6db6fd83 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033784 Sep 15 14:02:54.728201 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 15 14:02:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:02:57.414735 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-26cf7dbd-b218-43ba-88c1-973024c0b6e8 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:02:57.415794 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-26cf7dbd-b218-43ba-88c1-973024c0b6e8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 15 14:02:57.416194 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:02:57.840835 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-2093aa39-8c01-40bb-bd09-f8b5b814dfbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "swap": 0, "ram": 2048}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:57.861082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-2093aa39-8c01-40bb-bd09-f8b5b814dfbd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.438763 Sep 15 14:02:57.861657 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:02:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:02:57.873893 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-c5a6c9a2-da97-4582-96e4-080cef7f2196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:02:57.898725 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-c5a6c9a2-da97-4582-96e4-080cef7f2196 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028615 Sep 15 14:02:57.899336 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 15 14:02:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:03:00.495441 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-2093aa39-8c01-40bb-bd09-f8b5b814dfbd admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:00.496483 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-2093aa39-8c01-40bb-bd09-f8b5b814dfbd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 15 14:03:00.496879 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:00.910008 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-267303ea-530a-45db-a68c-5b0740fbedf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:00.931503 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-267303ea-530a-45db-a68c-5b0740fbedf5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427941 Sep 15 14:03:00.932085 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:03:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:00.944691 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-1e5629fd-904f-4005-b09f-fb4e8187b57e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:00.974358 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-1e5629fd-904f-4005-b09f-fb4e8187b57e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033269 Sep 15 14:03:00.974948 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 15 14:03:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:03:03.618777 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-267303ea-530a-45db-a68c-5b0740fbedf5 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:03.620088 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-267303ea-530a-45db-a68c-5b0740fbedf5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Sep 15 14:03:03.620899 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:04.085177 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-4bba3d3e-c1fc-4485-86de-21bd110f4b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "name": "m1.large", "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:04.090844 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:03:04.105979 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-4bba3d3e-c1fc-4485-86de-21bd110f4b35 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479171 Sep 15 14:03:04.106620 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:03:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:04.118511 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-85af293e-0145-4382-9f2f-7b0a0b5d4e12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:04.184674 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-85af293e-0145-4382-9f2f-7b0a0b5d4e12 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069602 Sep 15 14:03:04.185608 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 15 14:03:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:03:06.821835 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-4bba3d3e-c1fc-4485-86de-21bd110f4b35 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:06.822852 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-4bba3d3e-c1fc-4485-86de-21bd110f4b35 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 15 14:03:06.823253 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:03:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:07.337068 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:07.347790 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:03:07.358979 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.528340 Sep 15 14:03:07.359789 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 15 14:03:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 14:03:07.372260 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-ac3b46ef-0762-4705-adb5-f7dc1bf061bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:07.399424 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-ac3b46ef-0762-4705-adb5-f7dc1bf061bf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031113 Sep 15 14:03:07.400657 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 15 14:03:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:03:28.814672 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:28.815707 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 15 14:03:28.816117 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:28.827200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:03:29.218720 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d12b3179-2c44-489f-9933-68ccc770e8e9 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:29.237196 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d12b3179-2c44-489f-9933-68ccc770e8e9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415141 Sep 15 14:03:29.237740 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 15 14:03:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:30.548066 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:30.549075 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-973cc7f2-3b87-41d6-9ad7-e87a5feac29b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 15 14:03:30.549475 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:31.073816 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-6e2267d3-a5f1-4a36-b41e-9d3ddc1a8c07 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:31.079903 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-6e2267d3-a5f1-4a36-b41e-9d3ddc1a8c07 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-6e2267d3-a5f1-4a36-b41e-9d3ddc1a8c07 admin admin] Request method failure captured: Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept: application/json Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Connection: keep-alive Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Content-Length: 0 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Host: 10.222.0.27 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjIzCy0kLi2IF1Hr5pBfMOCbLnzeUhQXCzkdqBTh8eocFSizffEQmPKQxAqnPtDawr8wbkHwjhckhXvgH8AFMrOHBqcBd1oXTafCePaSuL0GrYGp79MScQxdVRdyjw655S_v1DQpGJ3cNlff9451Y2fZxuwwvKRolElFtlXPR9KuvgEt4 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Role: member,admin,reader Sep 15 14:03:31.083082 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Roles: member,admin,reader Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant: admin Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User: admin Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Name: admin Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: method: > Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: exception: Flavor 42 could not be found. Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: action_args: {'id': '42'} Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:31.084770 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:31.085808 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.087366 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-6e2267d3-a5f1-4a36-b41e-9d3ddc1a8c07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:31.088682 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-6e2267d3-a5f1-4a36-b41e-9d3ddc1a8c07 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396279 Sep 15 14:03:31.088682 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 15 14:03:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 14:03:31.094759 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-0edb6fc3-2c25-4052-92ae-3a1a92e707bf admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:31.118158 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-0edb6fc3-2c25-4052-92ae-3a1a92e707bf admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027383 Sep 15 14:03:31.118726 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:31.130094 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d5f6d3cb-4e91-423d-a999-be59daefc247 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:31.153659 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d5f6d3cb-4e91-423d-a999-be59daefc247 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027931 Sep 15 14:03:31.154179 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:31.163912 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8587e207-01eb-459d-b63b-2e153d647fdc admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:31.169346 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.wsgi [None req-8587e207-01eb-459d-b63b-2e153d647fdc admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8587e207-01eb-459d-b63b-2e153d647fdc admin admin] Request method failure captured: Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept: application/json Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept-Encoding: gzip, deflate Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Connection: keep-alive Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Content-Length: 0 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Host: 10.222.0.27 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-System-Scope: None Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: User-Agent: python-novaclient Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Auth-Token: gAAAAABjIzCy0kLi2IF1Hr5pBfMOCbLnzeUhQXCzkdqBTh8eocFSizffEQmPKQxAqnPtDawr8wbkHwjhckhXvgH8AFMrOHBqcBd1oXTafCePaSuL0GrYGp79MScQxdVRdyjw655S_v1DQpGJ3cNlff9451Y2fZxuwwvKRolElFtlXPR9KuvgEt4 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Id: None Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Name: None Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Identity-Status: Confirmed Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Is-Admin-Project: True Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Id: default Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Name: Default Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Name: admin Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Role: member,admin,reader Sep 15 14:03:31.172682 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Roles: member,admin,reader Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant: admin Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Name: admin Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User: admin Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Id: default Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Name: Default Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Name: admin Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: method: > Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: exception: Flavor 42 could not be found. Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: action_args: {'id': '42'} Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:31.174074 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:31.174914 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:31.176170 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8587e207-01eb-459d-b63b-2e153d647fdc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:31.177167 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-8587e207-01eb-459d-b63b-2e153d647fdc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014135 Sep 15 14:03:31.177167 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 15 14:03:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 14:03:32.394606 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-d5f6d3cb-4e91-423d-a999-be59daefc247 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:32.395662 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-d5f6d3cb-4e91-423d-a999-be59daefc247 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 15 14:03:32.396096 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:32.916554 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-adace793-aef0-4e9c-b2e5-66fb64fd6b3f admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:32.922407 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.wsgi [None req-adace793-aef0-4e9c-b2e5-66fb64fd6b3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-adace793-aef0-4e9c-b2e5-66fb64fd6b3f admin admin] Request method failure captured: Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept: application/json Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept-Encoding: gzip, deflate Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Connection: keep-alive Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Content-Length: 0 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Host: 10.222.0.27 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-System-Scope: None Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: User-Agent: python-novaclient Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Auth-Token: gAAAAABjIzC02jWkvBu3P3P6q8vtkWp_XgkK5objKef-2vEjYQhUlo6S2TjVUq6LLDvJKsZyFtEz5Z_9afsY2GFrlbbzDAL9AlPrlTFUHQvi-hMfyyXrL4x_ipsfW9YoiD_xQeZoXV7N4sQEQRV3TnS2aNwxdodE-eb_XqVjPhnau5xOrNhVGSE Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Id: None Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Name: None Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Identity-Status: Confirmed Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Is-Admin-Project: True Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Id: default Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Name: Default Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Name: admin Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Role: member,admin,reader Sep 15 14:03:32.923958 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Roles: member,admin,reader Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant: admin Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Name: admin Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User: admin Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Id: default Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Name: Default Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Name: admin Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: method: > Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: exception: Flavor 84 could not be found. Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: action_args: {'id': '84'} Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:32.925590 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:32.927627 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.928977 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-adace793-aef0-4e9c-b2e5-66fb64fd6b3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:32.930099 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-adace793-aef0-4e9c-b2e5-66fb64fd6b3f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389090 Sep 15 14:03:32.930099 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 15 14:03:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 14:03:32.935705 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-7c7a4539-cc3a-4b9c-a8da-5639708b4674 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:32.950496 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-7c7a4539-cc3a-4b9c-a8da-5639708b4674 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018717 Sep 15 14:03:32.951345 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:03:32.961303 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-3c324f63-6a38-4cf2-9e33-ce407d984d15 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:32.977588 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-3c324f63-6a38-4cf2-9e33-ce407d984d15 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019809 Sep 15 14:03:32.978105 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:32.988094 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-92100253-2ab3-4ee1-80cc-b0d55a4c219b admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:32.992973 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-92100253-2ab3-4ee1-80cc-b0d55a4c219b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-92100253-2ab3-4ee1-80cc-b0d55a4c219b admin admin] Request method failure captured: Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept: application/json Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Connection: keep-alive Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Content-Length: 0 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Host: 10.222.0.27 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjIzC02jWkvBu3P3P6q8vtkWp_XgkK5objKef-2vEjYQhUlo6S2TjVUq6LLDvJKsZyFtEz5Z_9afsY2GFrlbbzDAL9AlPrlTFUHQvi-hMfyyXrL4x_ipsfW9YoiD_xQeZoXV7N4sQEQRV3TnS2aNwxdodE-eb_XqVjPhnau5xOrNhVGSE Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Role: member,admin,reader Sep 15 14:03:32.994462 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Roles: member,admin,reader Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant: admin Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User: admin Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Name: admin Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: method: > Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: exception: Flavor 84 could not be found. Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: action_args: {'id': '84'} Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:32.996104 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:32.997181 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:32.998555 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-92100253-2ab3-4ee1-80cc-b0d55a4c219b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:32.999937 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-92100253-2ab3-4ee1-80cc-b0d55a4c219b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011183 Sep 15 14:03:32.999937 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 15 14:03:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 14:03:34.233331 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-3c324f63-6a38-4cf2-9e33-ce407d984d15 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:34.234338 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-3c324f63-6a38-4cf2-9e33-ce407d984d15 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 15 14:03:34.234737 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:34.754625 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-0e8d8274-9eef-4782-85f5-8294f597934e admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:34.760478 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.wsgi [None req-0e8d8274-9eef-4782-85f5-8294f597934e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-0e8d8274-9eef-4782-85f5-8294f597934e admin admin] Request method failure captured: Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept: application/json Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Accept-Encoding: gzip, deflate Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Connection: keep-alive Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Content-Length: 0 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Host: 10.222.0.27 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Openstack-System-Scope: None Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: User-Agent: python-novaclient Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Auth-Token: gAAAAABjIzC28l8Z7Tp6cFAAbYszAdxByWR86vX3ZJ62Vu1g4yr3JjUu7QJA1EQ-itcWC6Jjro0T2DbUW-pX9AHrxCxxLxzhPqBPJVgoZJrUkqA8nZeDRfCRBntLCJi4_rrdoPfGioaq4JTHitiVD5d2K2He7XigtQ7RTxCi8-kf6mIG_AtgJZs Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Id: None Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Domain-Name: None Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Identity-Status: Confirmed Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Is-Admin-Project: True Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Id: default Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Domain-Name: Default Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Project-Name: admin Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Role: member,admin,reader Sep 15 14:03:34.761970 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Roles: member,admin,reader Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant: admin Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-Tenant-Name: admin Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User: admin Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Id: default Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Domain-Name: Default Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: X-User-Name: admin Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: method: > Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: exception: Flavor 451 could not be found. Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: action_args: {'id': '451'} Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:34.764200 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:34.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.766519 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-0e8d8274-9eef-4782-85f5-8294f597934e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:34.767909 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-0e8d8274-9eef-4782-85f5-8294f597934e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390319 Sep 15 14:03:34.767909 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:03:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 14:03:34.773773 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-bdaabc43-ef3c-403a-aa63-b87bb903a129 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:34.789195 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-bdaabc43-ef3c-403a-aa63-b87bb903a129 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018938 Sep 15 14:03:34.789721 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:34.799169 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:34.813961 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018309 Sep 15 14:03:34.814477 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 15 14:03:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:03:34.823457 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-dc01002a-bd7b-4f6e-8471-14992c24292b admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:34.828838 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.wsgi [None req-dc01002a-bd7b-4f6e-8471-14992c24292b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-dc01002a-bd7b-4f6e-8471-14992c24292b admin admin] Request method failure captured: Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept: application/json Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Accept-Encoding: gzip, deflate Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Connection: keep-alive Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Content-Length: 0 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Host: 10.222.0.27 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-Api-Version: compute 2.92 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Openstack-System-Scope: None Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: User-Agent: python-novaclient Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Auth-Token: gAAAAABjIzC28l8Z7Tp6cFAAbYszAdxByWR86vX3ZJ62Vu1g4yr3JjUu7QJA1EQ-itcWC6Jjro0T2DbUW-pX9AHrxCxxLxzhPqBPJVgoZJrUkqA8nZeDRfCRBntLCJi4_rrdoPfGioaq4JTHitiVD5d2K2He7XigtQ7RTxCi8-kf6mIG_AtgJZs Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Id: None Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Domain-Name: None Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Identity-Status: Confirmed Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Is-Admin-Project: True Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Id: default Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Domain-Name: Default Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Project-Name: admin Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Role: member,admin,reader Sep 15 14:03:34.830324 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Roles: member,admin,reader Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f973480c94d94371b4cef62cd36d8410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f973480c94d94371b4cef62cd36d8410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f973480c94d94371b4cef62cd36d8410"}]}] Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant: admin Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Id: f973480c94d94371b4cef62cd36d8410 Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-Tenant-Name: admin Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User: admin Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Id: default Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Domain-Name: Default Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Id: 22bd926197084ae38005e05ce6f936ab Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: X-User-Name: admin Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: method: > Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: exception: Flavor 451 could not be found. Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: action_args: {'id': '451'} Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:03:34.831828 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:34.832787 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: ERROR nova.api.openstack.wsgi Sep 15 14:03:34.834030 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-dc01002a-bd7b-4f6e-8471-14992c24292b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:03:34.835208 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-dc01002a-bd7b-4f6e-8471-14992c24292b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011679 Sep 15 14:03:34.835208 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:03:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 14:03:36.041951 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:36.042963 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 15 14:03:36.043352 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:36.566528 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-16d16a58-0cd2-462f-b362-be5a392da497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:36.586045 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-16d16a58-0cd2-462f-b362-be5a392da497 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404786 Sep 15 14:03:36.586578 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 15 14:03:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:37.819126 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:37.820165 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 15 14:03:37.820554 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:38.345553 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-5646fe2a-5776-4cd3-abf0-74301aa69345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:38.363589 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-5646fe2a-5776-4cd3-abf0-74301aa69345 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405942 Sep 15 14:03:38.364185 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 15 14:03:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:39.589267 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:39.590444 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 15 14:03:39.590806 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:40.110592 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-2c924505-e12e-4980-a32c-7f1b30fb45ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:40.129240 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-2c924505-e12e-4980-a32c-7f1b30fb45ad admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399776 Sep 15 14:03:40.129774 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 15 14:03:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:41.351780 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:41.352793 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 15 14:03:41.353187 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:41.872986 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-e03feeac-9b97-4057-b683-7059af3a431e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:03:41.891991 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-e03feeac-9b97-4057-b683-7059af3a431e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400197 Sep 15 14:03:41.892558 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 15 14:03:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:03:43.138525 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:43.139593 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002454 Sep 15 14:03:43.140037 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:03:43.705896 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-58989528-8de7-4909-97de-58d93b9e01ec admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:03:43.725877 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-58989528-8de7-4909-97de-58d93b9e01ec admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.443314 Sep 15 14:03:43.726411 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Sep 15 14:03:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:04:40.369585 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.370911 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-fbcc2d6e-18d5-4b40-bb64-59970e451fcb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Sep 15 14:04:40.371433 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:04:40.382066 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:04:40.759373 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-1c9eaadc-e68a-443f-9d95-5d9071313d86 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.779974 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-1c9eaadc-e68a-443f-9d95-5d9071313d86 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402337 Sep 15 14:04:40.780512 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:04:40.801963 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=14 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:04:40.806552 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-9699efff-fb4e-4a71-82db-2ef0ae8c0f00 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.814103 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-9699efff-fb4e-4a71-82db-2ef0ae8c0f00 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013645 Sep 15 14:04:40.814613 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:04:40.826249 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-8da8c5c9-3e88-4e36-85f0-b4c8ac1fa1b6 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.833414 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-8da8c5c9-3e88-4e36-85f0-b4c8ac1fa1b6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010760 Sep 15 14:04:40.833927 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:04:40.845635 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.853416 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011241 Sep 15 14:04:40.853923 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:04:40.864983 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-29fd2a0f-ee70-40ee-96f0-c408bf661f81 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:04:40.872038 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-29fd2a0f-ee70-40ee-96f0-c408bf661f81 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010592 Sep 15 14:04:40.872574 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 15 14:04:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:07:39.904642 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:39.905662 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 15 14:07:39.906064 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:07:40.054267 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_api:SELECT=6 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:07:40.214049 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:40.218757 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:40.219254 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:40.220494 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:40.221465 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:40.221918 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:40.222337 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:40.256730 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-7ca72b24-17d6-46ce-a711-afe62d6eec9b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.203680 Sep 15 14:07:40.257291 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:07:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:07:41.339507 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:41.340541 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 15 14:07:41.340936 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:07:41.530187 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:41.533805 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:41.534286 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:41.534719 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:41.535433 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:41.535913 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:41.536336 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:41.556211 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-5fcc64f6-4d63-45eb-9b00-d511129f6343 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077347 Sep 15 14:07:41.556753 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:07:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:07:53.044433 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:53.045433 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 15 14:07:53.045835 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:07:53.190874 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_cell0:SELECT=4 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:07:53.191591 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_cell1:SELECT=4 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:07:53.192242 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG dbcounter [-] [105673] Writing DB stats nova_api:SELECT=8 {{(pid=105673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:07:53.240623 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:53.243982 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:53.244459 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:53.244885 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:53.245594 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:53.246041 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:53.246456 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:53.272487 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-6ae8a4a1-d901-4b45-9950-8f8df2c6300c admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085968 Sep 15 14:07:53.273043 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:07:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:07:54.351029 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG nova.api.openstack.wsgi [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] Calling method '>' {{(pid=105674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:54.352081 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: INFO nova.api.openstack.requestlog [None req-bcf41da2-1e02-48e1-9f8c-d9658d7e2234 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 15 14:07:54.352498 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: [pid: 105674|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 15 14:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:07:54.542720 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG nova.api.openstack.wsgi [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Calling method '>' {{(pid=105673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:07:54.546203 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:54.546686 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:54.547122 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:54.549070 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:07:54.549540 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:07:54.549971 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: DEBUG oslo_concurrency.lockutils [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:07:54.572683 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: INFO nova.api.openstack.requestlog [None req-cb36e972-bd03-414b-b949-2500e8a006d4 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080828 Sep 15 14:07:54.573353 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: [pid: 105673|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 15 14:07:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:08:52.273323 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: Thu Sep 15 14:08:52 2022 - graceful shutdown triggered... Sep 15 14:08:52.273053 dv-cinder-856971-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 14:08:52.274286 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: Gracefully killing worker 2 (pid: 105674)... Sep 15 14:08:52.274659 dv-cinder-856971-2-iscsi devstack@n-api.service[105673]: Gracefully killing worker 1 (pid: 105673)... Sep 15 14:08:52.402152 dv-cinder-856971-2-iscsi devstack@n-api.service[105674]: DEBUG dbcounter [-] [105674] Writing DB stats nova_api:SELECT=4 {{(pid=105674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:08:53.274082 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: worker 1 buried after 1 seconds Sep 15 14:08:53.274629 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: worker 2 buried after 1 seconds Sep 15 14:08:53.274629 dv-cinder-856971-2-iscsi devstack@n-api.service[105672]: goodbye to uWSGI. Sep 15 14:08:53.275667 dv-cinder-856971-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 14:08:53.276235 dv-cinder-856971-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 14:08:53.279032 dv-cinder-856971-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 14:08:53.293326 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 14:08:53 2022] *** Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: nodename: dv-cinder-856971-2-iscsi Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: machine: x86_64 Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: clock source: unix Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: pcre jit disabled Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: detected number of CPU cores: 4 Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: current working directory: / Sep 15 14:08:53.295336 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: detected binary path: /usr/bin/uwsgi-core Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: your processes number limit is 47680 Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: your memory page size is 4096 bytes Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: detected max file descriptor number: 2048 Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: lock engine: pthread robust mutexes Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: thunder lock: enabled Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 14:08:53.296109 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 14:08:53.336683 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: Python main interpreter initialized at 0x5653c87659c0 Sep 15 14:08:53.336683 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: python threads support enabled Sep 15 14:08:53.336683 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: your server socket listen backlog is limited to 100 connections Sep 15 14:08:53.336683 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: your mercy for graceful operations on workers is 90 seconds Sep 15 14:08:53.337100 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 14:08:53.337100 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: *** Operational MODE: preforking *** Sep 15 14:08:53.337384 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: *** uWSGI is running in multiple interpreter mode *** Sep 15 14:08:53.337384 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: spawned uWSGI master process (pid: 120633) Sep 15 14:08:53.337581 dv-cinder-856971-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 14:08:53.338153 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: spawned uWSGI worker 1 (pid: 120647, cores: 1) Sep 15 14:08:53.344172 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: spawned uWSGI worker 2 (pid: 120648, cores: 1) Sep 15 14:08:53.344991 dv-cinder-856971-2-iscsi devstack@n-api.service[120633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 14:08:54.012785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 14:08:54.015966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 14:08:55.190894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:08:55.190894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: from cryptography.utils import int_from_bytes Sep 15 14:08:55.191525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:08:55.191525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: from cryptography.utils import int_from_bytes Sep 15 14:08:55.192711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:08:55.192711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: from cryptography.utils import int_from_bytes Sep 15 14:08:55.193135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 14:08:55.193135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: from cryptography.utils import int_from_bytes Sep 15 14:08:57.642990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 14:08:57.643896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 14:08:57.644621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 14:08:57.644999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 14:08:57.645264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 14:08:57.645669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.646003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.646335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.646657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.646995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.647309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.647637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.647987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.648319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.648582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.648900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.649392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-2-iscsi {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.649721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.650033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.650347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.650673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.650980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.651306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.651614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.652146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.653885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.653885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.653885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.653885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.653885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.654313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.654557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.654757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.655074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.655390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.655815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-2-iscsi {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.656130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.656462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.656806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.657435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.657762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.658085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.658402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.659218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.659218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.659368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.659676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.660020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.660333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.660649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.661063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.661293 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.661678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.662018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.662305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.662561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.662875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.663203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.663406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 14:08:57.663892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.664050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 14:08:57.664217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.664217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.664571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 14:08:57.664737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.664896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 14:08:57.665050 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.665224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 14:08:57.665390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.665552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.665698 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.665886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.666986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.667997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.668945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-2-iscsi {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.669979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.670276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.670429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.671851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.671851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.672478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.672629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.672795 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.672949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.673097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.673097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.673371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.673565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.673887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.674962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.675969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-2-iscsi {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.676999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.677982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678297 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.678903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679233 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679440 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.679882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.680083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.680184 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.680390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.680492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.680970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.681925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.682901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683696 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.683910 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684147 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.684915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685534 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.685973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686150 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686763 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.686907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687372 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.687871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.688539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.688867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.688968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.689901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.690118 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.690220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.690460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.690568 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.690797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.690930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.691169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.691273 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.691425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.691533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.691754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.691865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.692066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.692182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.692390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.692511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.692723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.692819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.693029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.693131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.693325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.693424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.693586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.693689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.693894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.693996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.694210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.694304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.694516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.694610 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.694823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.694925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.695128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.695228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.695427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.695528 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.695789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.695904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.696072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.696174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.696380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.696518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.696686 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.696883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.697034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.697218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.697310 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.697547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.697647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.697879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.697964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.698184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.698274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.698488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.698587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.698805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.698897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.699125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.699216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.699430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.699527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.699758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.699847 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.700067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.700158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.700372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.700455 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.700688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.700769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.702248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.702378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.702493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.702581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.702666 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.702751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.702847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.702933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.703017 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.703109 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.703195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.703288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.703389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.703487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.703574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.704290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.704397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.704397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.704548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.704714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.704845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.704982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.705126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.705304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.705439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.705651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.705751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.706020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.706114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.706337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.706446 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.706642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.706737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.706948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.707050 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.707269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.707376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.707572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.707672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.707900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.707996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.708207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.708309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.708515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.708617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.708823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.708927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.709130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.709241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.709437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.709547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.709751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 14:08:57.709847 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.710816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711353 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.711854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.712924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713558 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.713970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714273 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714808 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.714931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715240 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.715873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716090 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.716820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717347 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717685 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.717783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718124 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718327 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718739 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.718964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.719064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.719299 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.719398 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.719623 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.719856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720088 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.720924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.721983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722817 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.722911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.723886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.724878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.725802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726630 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.726933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.727973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.728969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.729855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730545 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.730991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.731943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732684 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.732988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.733915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.734858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.735387 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.735485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.735608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.735830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.735966 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.736922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.737877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.738843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.739987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740696 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740904 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.740997 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.741986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.742830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743641 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.743990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.744942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.745999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.746917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747534 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.747890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748721 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.748816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.749957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.750049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.750275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.750378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.751144 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.751250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.751526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.751792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.752896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.753843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754469 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.754994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.755284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.755384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.755605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.755730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.755956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.756995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757623 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.757954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.758884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.759835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760339 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.760949 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.761958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762639 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.762888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763086 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.763828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764440 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764757 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.764954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765256 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765682 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.765989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.766829 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.767810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768162 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.768989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.769921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770233 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770648 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.770949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771569 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771792 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.771890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.772830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773131 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773327 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773763 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.773952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774055 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.774989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.775191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.775446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.775577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.775805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.775927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.776838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.777795 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778109 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.778926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.779976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780482 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.780891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781192 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781484 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781692 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.781815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.782125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.782229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.782441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.782688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.782805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.783983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.784905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.785978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.786947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.787904 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.788821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789433 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.789943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790564 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.790975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.791919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.792838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793371 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.793967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.794886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795817 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.795940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.796827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797044 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.797812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.798989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799876 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.799985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.800882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.801828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.802904 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.803106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.803230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.803415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.803558 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.803825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804379 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.804793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805134 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805322 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.805959 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.806054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.806528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.806646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.806846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.806942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.807994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.808962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.809143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.809289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.809391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.810204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.810356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.810487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.810608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.815909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.816890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.817850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818204 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818345 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.818905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.819038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.819183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.819791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.819901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.820973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821795 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.821969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.822865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.823974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824610 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824696 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.824973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.825974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.826940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.827898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.828106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.828235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.828359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.828503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.829212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.829355 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.829654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.829794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.830903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.831903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832116 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.832869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833055 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.833795 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.834980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.835950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836057 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836385 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836682 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.836981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.837904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.838119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.838354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.838463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.838686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.838791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.839976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840088 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.840924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.841956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.842858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843233 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843510 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.843857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.844081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.844260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.844965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.845110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.845286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.845599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.845694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.845921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846024 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.846980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.847192 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.847287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.847511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.847605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.847849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.848898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.849993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.850919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851826 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.851971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852573 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.852847 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853094 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.853825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.854972 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855698 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.855937 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.856865 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.857859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858076 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858404 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858639 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.858950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.859072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.859261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.859368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.859574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.859709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.860536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.860702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.860871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.861878 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.862807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.863778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864732 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.864928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865551 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865860 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.865955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.866883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.867846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868703 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.868965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.869921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870697 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.870975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.871178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.871279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.871496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.871704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.871874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.872038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.872198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.872370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.872693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.872798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.873982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874683 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.874900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.875003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.875209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.875314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.876053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.876204 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.876383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.876602 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.876709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.877987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.878082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.878330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.878524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.878629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.878871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.879975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.880947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881538 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.881847 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.882964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.883912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.884965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885610 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.885937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886373 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.886914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.887994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.888232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.888335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.888574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.888677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.888904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889532 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.889943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.890906 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.891069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.891729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.892043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.892209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.892379 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.892699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.892801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.893910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.894961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.895879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.896800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897628 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.897933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.898963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.899907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.900835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.901802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902017 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902118 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902439 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.902966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.903922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904057 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.904986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905293 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.905925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906139 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.906924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.907131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.907405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.907513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.907754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.907868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908386 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.908803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.909980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.910915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911010 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.911974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.912923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.913802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 14:08:57.914005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.914306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.914612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.914913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.915213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.915513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.915839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.916142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.916442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.916748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.917048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.917349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.917647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.917948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.918247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.918571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.918899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.919212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.919531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.919862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.920182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.920489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.920806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.921122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.921434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.921739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.922072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.922435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.923003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.923385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.923717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.924037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.924346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.924676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.925001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.925307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.925631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.925947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.926266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.926582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.926897 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.927226 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.927536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.927880 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.928190 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.928512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.928807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.929121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.929429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.929737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.930052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.930363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.930687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.931008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.931567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.931915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.932238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.932579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.932889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.933229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.933554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.933872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.934182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.934487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 14:08:57.934729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 14:08:57.976049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Registered counter for database nova_api Sep 15 14:08:57.998181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.001686 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO dbcounter [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Registered counter for database nova_api Sep 15 14:08:58.005474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.021759 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_db.sqlalchemy.engines [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.028344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writer thread running {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.062252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.context [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),420e8343-b5ad-47f2-88fe-eb0072589000(cell1) {{(pid=120648) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 14:08:58.066939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:08:58.067485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:08:58.069163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:08:58.069940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:08:58.070449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:08:58.072493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:08:58.074483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Registered counter for database nova_cell0 Sep 15 14:08:58.078598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Registered counter for database nova_cell1 Sep 15 14:08:58.088094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.088831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.context [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),420e8343-b5ad-47f2-88fe-eb0072589000(cell1) {{(pid=120647) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 14:08:58.088956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.092892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:08:58.093364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:08:58.095354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:08:58.096153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:08:58.096602 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:08:58.096882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.097226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.098626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:08:58.100645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO dbcounter [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Registered counter for database nova_cell0 Sep 15 14:08:58.104922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO dbcounter [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Registered counter for database nova_cell1 Sep 15 14:08:58.113593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_db.sqlalchemy.engines [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.115320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_db.sqlalchemy.engines [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.121431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writer thread running {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.123529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writer thread running {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.251562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO dbcounter [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Registered counter for database nova_cell0 Sep 15 14:08:58.258644 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_db.sqlalchemy.engines [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.263399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writer thread running {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.278945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO dbcounter [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Registered counter for database nova_cell0 Sep 15 14:08:58.288436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_db.sqlalchemy.engines [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 14:08:58.293128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writer thread running {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 14:08:58.589350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:08:58.597182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:08:58.620967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: WARNING keystonemiddleware.auth_token [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:08:58.628946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: WARNING keystonemiddleware.auth_token [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:08:58.947451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:08:58.953514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: WARNING keystonemiddleware.auth_token [None req-2e6224a3-f5b9-4268-af5b-912e8050582f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:08:58.959430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653c87659c0 pid: 120648 (default app) Sep 15 14:08:58.977074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: WARNING keystonemiddleware.auth_token [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 14:08:58.983639 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: WARNING keystonemiddleware.auth_token [None req-2143e28e-1aca-43a1-a410-0cb22aa711be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 14:08:58.989770 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653c87659c0 pid: 120647 (default app) Sep 15 14:09:35.316168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.317072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.317869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.318668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.521571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.526413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.530422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:35.531406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:36.974088 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f40aa731-0a30-4f33-ae73-efd173cbd0ec tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Action: 'create', calling method: .version_select at 0x7fab487f0430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1523317321", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f40aa731-0a30-4f33-ae73-efd173cbd0ec tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 122 Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:36.992230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1523317321", "metadata": {"Type": "work"}}} Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:36.993884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1523317321', 'metadata': {'Type': 'work'}}}} Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:36.994924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 14:09:36.996639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 14:09:36.997985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 14:09:36.997985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.003173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f40aa731-0a30-4f33-ae73-efd173cbd0ec tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:37.004492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f40aa731-0a30-4f33-ae73-efd173cbd0ec tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.698722 Sep 15 14:09:37.009496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 15 14:09:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1705 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:09:37.020823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb7aa617-dc96-430f-8a61-6421adec6628 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Action: 'create', calling method: .version_select at 0x7fab487f0d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296771771", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb7aa617-dc96-430f-8a61-6421adec6628 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 119 Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:37.046550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296771771", "metadata": {"Type": "work"}}} Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:37.049261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-296771771', 'metadata': {'Type': 'work'}}}} Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '0' Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:37.050342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 14:09:37.052414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 14:09:37.053809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 14:09:37.053809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.053809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb7aa617-dc96-430f-8a61-6421adec6628 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:37.053809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb7aa617-dc96-430f-8a61-6421adec6628 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037769 Sep 15 14:09:37.053809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 15 14:09:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:09:37.066663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d4d5baff-ccd8-4273-8760-f37bc1ca7a00 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Action: 'create', calling method: .version_select at 0x7fab486ad160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-765964545", "metadata": {"Type": "work"}}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d4d5baff-ccd8-4273-8760-f37bc1ca7a00 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 118 Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:37.077823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-765964545", "metadata": {"Type": "work"}}} Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:37.079978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-765964545', 'metadata': {'Type': 'work'}}}} Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise error Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi '' Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:37.080974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 14:09:37.082399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 14:09:37.084212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 14:09:37.084212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.084212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d4d5baff-ccd8-4273-8760-f37bc1ca7a00 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:37.092340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d4d5baff-ccd8-4273-8760-f37bc1ca7a00 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032328 Sep 15 14:09:37.092956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 15 14:09:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:09:37.107981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4fac71a9-654d-4ddc-9ce3-200bbcb1c294 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Calling method '.version_select at 0x7fab486adc10>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:37.293545 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-87b5eeaa-af7d-4daf-9ffd-67da79b29820 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Action: 'create', calling method: .version_select at 0x7fab487ef4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-522719096", "metadata": {"Type": "work"}}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:37.848410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-4fac71a9-654d-4ddc-9ce3-200bbcb1c294 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] HTTP exception thrown: Volume tempest-invalid-1312938386 could not be found. Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4fac71a9-654d-4ddc-9ce3-200bbcb1c294 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1312938386 HTTP/1.1 Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:37.853403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume tempest-invalid-1312938386 could not be found. Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'tempest-invalid-1312938386'} Sep 15 14:09:37.854894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1312938386 could not be found. (HTTP 404) (Request-ID: req-83c1161f-7fce-4a37-9ab4-a8b9eb31de00) Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.855799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:09:37.856995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1312938386 could not be found. Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:09:37.858269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1312938386 could not be found. Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1312938386 could not be found. Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4fac71a9-654d-4ddc-9ce3-200bbcb1c294 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 404 to user: Volume tempest-invalid-1312938386 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4fac71a9-654d-4ddc-9ce3-200bbcb1c294 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1312938386" status: 404 len: 99 microversion: 2.1 time: 0.756032 Sep 15 14:09:37.859531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 15 14:09:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1312938386 => generated 99 bytes in 758 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 15 14:09:37.871853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6c90f3a5-115d-4f93-9ab1-cfe0d691c899 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006590 Sep 15 14:09:37.874743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 15 14:09:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 14:09:37.889325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4cdec6ab-0095-413e-ac21-30547349cb51 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003761 Sep 15 14:09:37.890555 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 15 14:09:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 14:09:37.900426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d1a5bbb1-a424-4248-9141-a3126b2da41b tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Calling method '.version_select at 0x7fab485de310>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:37.973292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-d1a5bbb1-a424-4248-9141-a3126b2da41b tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] HTTP exception thrown: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d1a5bbb1-a424-4248-9141-a3126b2da41b tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/os-volumes/c304b299-979e-48c9-bc23-816c5c8e4d0b HTTP/1.1 Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:37.978559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'c304b299-979e-48c9-bc23-816c5c8e4d0b'} Sep 15 14:09:37.980702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. (HTTP 404) (Request-ID: req-a60c9767-9a6a-4c21-854f-af408013f534) Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.982035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:09:37.983465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 14:09:37.985492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d1a5bbb1-a424-4248-9141-a3126b2da41b tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 404 to user: Volume c304b299-979e-48c9-bc23-816c5c8e4d0b could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d1a5bbb1-a424-4248-9141-a3126b2da41b tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/c304b299-979e-48c9-bc23-816c5c8e4d0b" status: 404 len: 109 microversion: 2.1 time: 0.084048 Sep 15 14:09:37.986831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:09:37 2022] DELETE /compute/v2.1/os-volumes/c304b299-979e-48c9-bc23-816c5c8e4d0b => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:09:37.996677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d170218-eb5d-46a0-9af4-0b13fbaca4d8 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Calling method '.version_select at 0x7fab485de1f0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:38.057068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-2d170218-eb5d-46a0-9af4-0b13fbaca4d8 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] HTTP exception thrown: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d170218-eb5d-46a0-9af4-0b13fbaca4d8 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Request method failure captured: Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/23c59be4-5baa-47de-8026-9c04574d512a HTTP/1.1 Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfk9Ee51voovjLhVK-CHRIcU5r-1YkQQ0OtY23VB1B2xp4mi_kuHwlChSbvAPre9eLSja-oeRJGDxeA7sZSBNiv-AcuG7DuFX0I-jyCp4e1XXohhOW1PdoV4aG8Z0-uQkqAAznzzZMtV5wjNEX4PLTWsMox1Ik3eiitm8g1cDilqQ Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:38.059367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96b37cc8c62e4096b072abff9b051def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96b37cc8c62e4096b072abff9b051def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96b37cc8c62e4096b072abff9b051def"}]}] Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 96b37cc8c62e4096b072abff9b051def Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-904581353 Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: d9baa62cc65147719248fe7e898dbb8d Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-904581353-project Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '23c59be4-5baa-47de-8026-9c04574d512a'} Sep 15 14:09:38.060925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. (HTTP 404) (Request-ID: req-b259b444-3c17-4bd0-9874-c45642d5c7eb) Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:38.061934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:09:38.063207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 14:09:38.064346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. Sep 15 14:09:38.067052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:38.069640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d170218-eb5d-46a0-9af4-0b13fbaca4d8 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] Returning 404 to user: Volume 23c59be4-5baa-47de-8026-9c04574d512a could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:38.070996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2d170218-eb5d-46a0-9af4-0b13fbaca4d8 tempest-VolumesNegativeTest-904581353 tempest-VolumesNegativeTest-904581353-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/23c59be4-5baa-47de-8026-9c04574d512a" status: 404 len: 109 microversion: 2.1 time: 0.082252 Sep 15 14:09:38.071869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 8/8] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:37 2022] GET /compute/v2.1/os-volumes/23c59be4-5baa-47de-8026-9c04574d512a => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:09:39.462523 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-87b5eeaa-af7d-4daf-9ffd-67da79b29820 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.952723 Sep 15 14:09:39.465167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 1/9] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 15 14:09:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3957 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 14:09:39.481909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-af9c81d0-8f64-4059-b2ba-b34880a49156 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab486ad4c0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:39.613592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-af9c81d0-8f64-4059-b2ba-b34880a49156 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 200 len: 352 microversion: 2.1 time: 0.135966 Sep 15 14:09:39.613592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 9/10] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:39 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:09:40.627229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-96a5de08-0238-4ab3-a990-60ffd3d9c2b3 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab486c13a0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:40.753635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-96a5de08-0238-4ab3-a990-60ffd3d9c2b3 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 200 len: 352 microversion: 2.1 time: 0.130641 Sep 15 14:09:40.754309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 2/11] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:40 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:09:41.772147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-660b5d54-7cc0-49aa-b031-50fa73898efb tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab485de940>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:41.879615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-660b5d54-7cc0-49aa-b031-50fa73898efb tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 200 len: 353 microversion: 2.1 time: 0.113067 Sep 15 14:09:41.887736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 10/12] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:41 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:09:41.901839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-992154ac-5c8f-4b8d-8dc0-daba0597aaac tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab486c1a60>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:42.007360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-992154ac-5c8f-4b8d-8dc0-daba0597aaac tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 200 len: 353 microversion: 2.1 time: 0.112197 Sep 15 14:09:42.008081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 3/13] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:41 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:09:42.033032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6ddfe6d-115a-4f57-a391-399a35200fa3 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab485de160>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:42.214924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6ddfe6d-115a-4f57-a391-399a35200fa3 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 202 len: 0 microversion: 2.1 time: 0.191226 Sep 15 14:09:42.219586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 11/14] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:09:42 2022] DELETE /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:09:42.230831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-91f72ce5-4e60-4b7c-9ff0-d7ab9b9c09c7 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab4865b160>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:42.340030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-91f72ce5-4e60-4b7c-9ff0-d7ab9b9c09c7 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 200 len: 352 microversion: 2.1 time: 0.118943 Sep 15 14:09:42.341715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 4/15] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:42 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:09:43.359319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9fe9095a-2193-4008-bea1-abac2fdaf299 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Calling method '.version_select at 0x7fab485def70>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:43.434208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-9fe9095a-2193-4008-bea1-abac2fdaf299 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] HTTP exception thrown: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9fe9095a-2193-4008-bea1-abac2fdaf299 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Request method failure captured: Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa HTTP/1.1 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIfhCyc6HPeYLIHMUWQH1P9th-HMdWNL3ahPI__ZlwnQ_E-J2JBK6PxKZjw56lwrHUOP_TVHon6qIdMUJVF-qvdJNIfPHGGAkuZlDGOzgIrhK4KM6Negz7zJNfdM-iOIa0WzAYNH-T4shnEqUFkbLY-2eQQhYgzE2PQ_6WzEwdROVU Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 08233653cc71488393a34f602b7fd885 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesGetTestJSON-658396341 Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:09:43.436163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08233653cc71488393a34f602b7fd885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08233653cc71488393a34f602b7fd885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08233653cc71488393a34f602b7fd885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08233653cc71488393a34f602b7fd885"}]}] Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesGetTestJSON-658396341 Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 08233653cc71488393a34f602b7fd885 Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesGetTestJSON-658396341 Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesGetTestJSON-658396341-project Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 22bd431202dc4bb7a3e2741a7c1a51b8 Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesGetTestJSON-658396341-project Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa'} Sep 15 14:09:43.437537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. (HTTP 404) (Request-ID: req-3b0ae24e-1cef-4adf-9181-9ff243b8e46a) Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:43.442183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:09:43.443320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 14:09:43.444422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9fe9095a-2193-4008-bea1-abac2fdaf299 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] Returning 404 to user: Volume fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9fe9095a-2193-4008-bea1-abac2fdaf299 tempest-VolumesGetTestJSON-658396341 tempest-VolumesGetTestJSON-658396341-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa" status: 404 len: 109 microversion: 2.1 time: 0.086750 Sep 15 14:09:43.445507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 12/16] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:09:43 2022] GET /compute/v2.1/os-volumes/fb9a0e7e-7665-4d77-8d96-fc4f062c6ffa => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:09:44.873006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-84d60dcb-88c4-4288-86e4-bffde02d3a8b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: .version_select at 0x7fab486c1dc0>, body: {"keypair": {"name": "tempest-keypair-701967591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ChA9TRd5/wDLeta3fVtqYY50EvthGkRN6Lbc+cdhihQsl/FLeJbfK6vcZEuRnT3mQ3+YTzBRosSEUA07PyX8lEpXXeK7qyMIyJtVIEyyEpxuIKsAx0V2etQsL4E+nhg=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:44.968585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-84d60dcb-88c4-4288-86e4-bffde02d3a8b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for project a8297077982a4338a2d687c89e1119a2. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:45.022980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-84d60dcb-88c4-4288-86e4-bffde02d3a8b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for user 2049d66708ce47a794c14ad4c2040937 and project a8297077982a4338a2d687c89e1119a2. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:45.100709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-84d60dcb-88c4-4288-86e4-bffde02d3a8b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.793633 Sep 15 14:09:45.101526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 5/17] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:09:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:09:53.458843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-797349798", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "networks": [{"uuid": "3e00453e-4367-4375-85b1-d29fb4428e97"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:53.731818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] validate_networks() for [('3e00453e-4367-4375-85b1-d29fb4428e97', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:09:53.790999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1704592577", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8bdfa6d-ee93-493a-aa98-3784c4bb267f"}], "security_groups": [{"name": "tempest-securitygroup--566221192"}], "key_name": "tempest-keypair-701967591", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:54.097542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] validate_networks() for [('e8bdfa6d-ee93-493a-aa98-3784c4bb267f', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:09:55.056722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=4 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:09:55.776913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:09:55.777199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:09:55.777681 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:09:55.778091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:09:55.778495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:09:55.797323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:55.797805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:55.798237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:55.798954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:55.799400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:55.799842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:55.868977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for project a8297077982a4338a2d687c89e1119a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:55.877796 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for user 2049d66708ce47a794c14ad4c2040937 and project a8297077982a4338a2d687c89e1119a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:55.924508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:09:55.932892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:09:56.056139 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:09:56.057590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:09:56.058551 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:09:56.059210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:09:56.059890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:09:56.074653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b6f77cb1-f004-4ced-ad9b-497e52fbaef0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.288551 Sep 15 14:09:56.078953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 6/18] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:09:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:09:56.094773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:56.095317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:56.101177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:56.103108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:56.103993 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:56.105280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:56.182915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Getting quotas for project d903de84a9c7446e9a2f368e5eab8719. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:56.191422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Getting quotas for user f521b038310940d1b5ee7fc5afc1cbac and project d903de84a9c7446e9a2f368e5eab8719. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:56.210237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:09:56.213769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:09:56.347273 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e30bbab4-60c0-407f-9b75-d786889a4b16 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.702918 Sep 15 14:09:56.353322 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 13/19] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:09:56.364941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ca692629-3691-4155-a796-3e5e3424ce09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:56.366289 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ca692629-3691-4155-a796-3e5e3424ce09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:56.582365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ca692629-3691-4155-a796-3e5e3424ce09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:56.639136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ca692629-3691-4155-a796-3e5e3424ce09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1237 microversion: 2.1 time: 0.284199 Sep 15 14:09:56.640180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:56 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1237 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:56.653727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c3910106-f9db-4d6d-a837-9500d933296f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:56.654357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c3910106-f9db-4d6d-a837-9500d933296f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:56.670396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-770146220", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:56.819445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c3910106-f9db-4d6d-a837-9500d933296f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:56.821045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] validate_networks() for [('4bf6b9d0-61d2-43ca-8735-1d5e3544a1e6', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:09:56.830775 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c3910106-f9db-4d6d-a837-9500d933296f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1214 microversion: 2.1 time: 0.188893 Sep 15 14:09:56.846255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 15/21] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:56 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:57.102715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b39c2f89-9766-49d0-98dc-c28d08cf8cf5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: .version_select at 0x7fab47c95dc0>, body: {"keypair": {"name": "tempest-keypair-194381711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+i4OTKEX7yet6lqMHtdggZw2OlF9GTLRtsNdyAOboILZ5LorOcF+TFAOjx1GFoSuaKgIXZD8tjZeeuLZdDwNxhjpVhwMKlITcQYl/AgJ60gDKAmAYhOx9k9YM+h4k8dQ=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:57.173394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-b39c2f89-9766-49d0-98dc-c28d08cf8cf5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for project e76574d5f2094997a9c565d4ddf2a483. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:57.183986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-b39c2f89-9766-49d0-98dc-c28d08cf8cf5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for user 00374d3d3bf649749781792273e35e3b and project e76574d5f2094997a9c565d4ddf2a483. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:57.242048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b39c2f89-9766-49d0-98dc-c28d08cf8cf5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.233243 Sep 15 14:09:57.243271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 16/22] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 15 14:09:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 14:09:57.675893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1a206298-8a4e-4252-ae15-89e9799e1dae tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:57.676937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1a206298-8a4e-4252-ae15-89e9799e1dae tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:57.704353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:09:57.706611 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:09:57.708753 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:09:57.709424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:09:57.710704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:09:57.758933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:57.760398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:57.761714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:57.765866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:57.766556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:57.770004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:57.836359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:57.851108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for user 530e6587b39b4f4c98d7414b81453628 and project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:57.884046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1a206298-8a4e-4252-ae15-89e9799e1dae tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:57.892652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1a206298-8a4e-4252-ae15-89e9799e1dae tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1237 microversion: 2.1 time: 0.232960 Sep 15 14:09:57.892863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:09:57.897122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 17/23] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:57 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1237 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:57.902018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d7a09eb9-02d1-43ab-b888-ba2c3d45220b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:57.902885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:09:57.912707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d7a09eb9-02d1-43ab-b888-ba2c3d45220b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:58.017379 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d7a09eb9-02d1-43ab-b888-ba2c3d45220b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:58.028623 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d7a09eb9-02d1-43ab-b888-ba2c3d45220b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1214 microversion: 2.1 time: 0.129887 Sep 15 14:09:58.029908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 18/24] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:57 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:58.062057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-134329f1-1df0-411e-9b55-65550ec5f481 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.981326 Sep 15 14:09:58.062802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 7/25] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:09:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:09:58.077008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1adc863b-3b76-4fcc-9e7b-e6855cc21d0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:58.079158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1adc863b-3b76-4fcc-9e7b-e6855cc21d0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:58.210226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1adc863b-3b76-4fcc-9e7b-e6855cc21d0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:58.219430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1adc863b-3b76-4fcc-9e7b-e6855cc21d0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1221 microversion: 2.1 time: 0.146359 Sep 15 14:09:58.221106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 19/26] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:58 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:58.505723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1921475568", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:09:58.606702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] validate_networks() for [('4bf6b9d0-61d2-43ca-8735-1d5e3544a1e6', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:09:58.921312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:58.921964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:58.932176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:58.934208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:58.934642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:58.938889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:58.939526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:58.940650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:59.319560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:59.346745 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aec56695-a99d-46f3-8cbd-c714fa47ada3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1233 microversion: 2.1 time: 0.428067 Sep 15 14:09:59.348219 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 20/27] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:58 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1233 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:09:59.385828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:09:59.386615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:09:59.410244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:59.411962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:59.413643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:59.416327 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:59.417022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:59.420246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:59.853054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:09:59.853655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:09:59.854302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:09:59.855444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:09:59.856003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:09:59.876626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:59.877366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:59.877953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:59.878974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:09:59.879775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:09:59.880513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:09:59.901738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:09:59.909120 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for user 530e6587b39b4f4c98d7414b81453628 and project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:09:59.916636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:09:59.928722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:09:59.932534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:09:59.934784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9ff15dc4-550a-46d5-bce8-6efc50e4a163 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1210 microversion: 2.1 time: 0.582542 Sep 15 14:09:59.957278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 21/28] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:09:59 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1210 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:00.089227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c768c56f-a5ec-4488-a33b-c794ebf4489f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.588685 Sep 15 14:10:00.090540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 8/29] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:09:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:10:00.105553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0ab98b91-8979-43c6-bbe5-3bd0a299f9e3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:00.106672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0ab98b91-8979-43c6-bbe5-3bd0a299f9e3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:00.378712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:00.379342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:00.423458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:00.430031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:00.432214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:00.432991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:00.456017 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:00.458765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:01.042226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0ab98b91-8979-43c6-bbe5-3bd0a299f9e3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:01.059083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0ab98b91-8979-43c6-bbe5-3bd0a299f9e3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1222 microversion: 2.1 time: 0.960217 Sep 15 14:10:01.061658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 22/30] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:00 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1222 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:01.076660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:01.077509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:01.092267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:01.094841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:01.095473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:01.097766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:01.098757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:01.100193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:01.185103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:01.252922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a59d8c90-5552-43e0-b4cd-71e9de96920a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1307 microversion: 2.1 time: 0.883956 Sep 15 14:10:01.263131 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 9/31] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:00 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1307 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:01.463384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:01.491288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4963bb7e-cd75-4ec6-b348-ba249dd78c40 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1266 microversion: 2.1 time: 0.422749 Sep 15 14:10:01.495727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 23/32] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:01 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:01.712372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-185346566", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "120cc345-9098-45c5-ab11-9d46cb943f4b"}], "security_groups": [{"name": "tempest-securitygroup--1506616449"}], "key_name": "tempest-keypair-194381711", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:02.090271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:02.091274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:02.104835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.105333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.107548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.108507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.112878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.114676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.227516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] validate_networks() for [('120cc345-9098-45c5-ab11-9d46cb943f4b', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:10:02.264850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:02.278046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-40d19da0-a733-4660-b6b9-883a6289954b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.193514 Sep 15 14:10:02.279182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 24/33] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:02 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:02.295265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:02.296133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:02.324305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.325100 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.325784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.326715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.327555 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.329649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.469321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:02.506034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8006f360-ed53-44a4-b32e-f77b305ad54c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1295 microversion: 2.1 time: 0.216942 Sep 15 14:10:02.562170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 25/34] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:02 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1295 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:02.589862 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:02.590706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:02.605361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.606034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.606625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.617127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:02.617913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:02.618699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:02.792520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:02.807812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-15afa57b-44b1-464f-b4b8-883079b2f905 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1274 microversion: 2.1 time: 0.236478 Sep 15 14:10:02.808981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 26/35] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:02 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:03.318165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:03.319498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:03.333135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.334133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.335478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.338794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.342536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.345375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.455826 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:03.464207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-057c0d9e-ac6e-4ed1-bd14-db7580a7cab1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.160179 Sep 15 14:10:03.464790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 27/36] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:03 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:03.539083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:03.540151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:03.550150 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.551173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.552081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.553407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.554357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.555026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.793189 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:03.804289 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d492aba8-1918-40ed-b545-922e1c3627d6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.268398 Sep 15 14:10:03.807393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 28/37] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:03 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:03.829888 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:10:03.831322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:10:03.831978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:10:03.832559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:10:03.833121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:10:03.835919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:03.836552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:03.848931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.849818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.850347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.855655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.855902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.856511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.856899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.857258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.858665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.860277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:03.863782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:03.864428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:03.907006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for project e76574d5f2094997a9c565d4ddf2a483. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:10:03.916847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for user 00374d3d3bf649749781792273e35e3b and project e76574d5f2094997a9c565d4ddf2a483. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:10:03.947577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:10:03.949940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:10:04.004709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:04.035122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d373b4eb-668d-4462-8a53-8e60664ca2ef tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1274 microversion: 2.1 time: 0.203116 Sep 15 14:10:04.035845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 29/38] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:03 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:04.063263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-01e7a927-fe40-4f74-bca4-bf170af74e59 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.355071 Sep 15 14:10:04.063974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 10/39] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 15 14:10:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 14:10:04.075916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:04.076469 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:04.218349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:04.227006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:04.228925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:04.230968 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-879a3ec0-abea-4caf-a7a6-62416d335a41 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1280 microversion: 2.20 time: 0.158608 Sep 15 14:10:04.246237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 30/40] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:04 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:04.487529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:04.488264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:04.496922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:04.498933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:04.500773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:04.502020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:04.504548 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:04.505075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:04.636380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:04.645770 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9d1c25fe-5025-41ff-8060-17f573775169 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.162781 Sep 15 14:10:04.646352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 11/41] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:04 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:04.834031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:04.835300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:04.841419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:04.841902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:04.842333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:04.843114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:04.844190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:04.844684 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:04.997739 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.007179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c2637939-a4df-47ce-ae0d-e724c162b15b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.176923 Sep 15 14:10:05.008565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 31/42] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:04 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:05.066842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:05.068127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:05.079287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.079909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.080525 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.081421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.082088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.082700 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.260491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:05.260934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:05.270869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.271362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.273653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.274645 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.275290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.276450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.295909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.308936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f2ec865d-2835-4305-a838-202224df6760 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1284 microversion: 2.1 time: 0.253202 Sep 15 14:10:05.312721 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 12/43] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:05 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:05.365235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.373866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.376697 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.378212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1cdedf6b-4965-487c-8dd8-5421046a6457 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.121702 Sep 15 14:10:05.379294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 32/44] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:05 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:05.677480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:05.678106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:05.680070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=13 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:05.696603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.697105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.698060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.698797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:05.699260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:05.699714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:05.827906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:05.837006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-679cc00b-190a-423c-9016-ec54fbc0d1e6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.170330 Sep 15 14:10:05.837938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 13/45] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:05 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:06.032736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:06.034266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:06.053364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.054544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.055303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.056388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.057620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.058672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.168240 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:06.294366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.306249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-def2c1ec-2004-4ad0-8d8e-5922f378f73e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.276489 Sep 15 14:10:06.306854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 33/46] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:06 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:06.344679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:06.345305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:06.351325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.352156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.353095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.354078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.354712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.355152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.407860 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:06.408564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:06.418026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.418527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.418950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.424692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.425180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.425619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.452737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.464595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2d38eb50-c705-413c-8a7d-4df5fbe1e21c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1284 microversion: 2.1 time: 0.124685 Sep 15 14:10:06.466559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 14/47] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:06 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:06.540036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.556762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.577347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.585019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-183fcd1a-9e09-4035-ba6b-fee9a37140fc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.182585 Sep 15 14:10:06.589774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 34/48] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:06 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:06.865102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:06.866135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:06.874824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.875515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.875975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.877168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:06.877632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:06.879431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:06.982905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:06.994544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f834bddb-d315-4ef5-845c-ae2fca8b4151 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.134225 Sep 15 14:10:06.995784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 15/49] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:06 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:07.334910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:07.335703 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:07.342510 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.348776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.349600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.350356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.350896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.351400 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.490012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:07.491417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:07.506240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.508606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.510346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.513780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.516767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.517453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.548468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:07.571907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0c9a27a1-e6bb-4be6-a356-7d3fee26b5ab tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.240692 Sep 15 14:10:07.572870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 35/50] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:07 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:07.620271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:07.621941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:07.633602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.640028 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.640838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.641678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:07.642344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:07.643023 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:07.643540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:07.679270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6dd378cd-94ce-4bf2-b0dd-4477e0f835be tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1284 microversion: 2.1 time: 0.191496 Sep 15 14:10:07.683789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 16/51] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:07 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:07.739163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:07.748079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:07.751177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:07.752467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-421f5cb6-cc6b-41f3-afb6-6a72ecf27a43 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.136553 Sep 15 14:10:07.753735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 36/52] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:07 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:08.023455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:08.024248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:08.043304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.043842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.044286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.044997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.045453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.048736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.139202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:08.148499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7a96a62e-1968-4fd1-9a01-74f2e02cce9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.129510 Sep 15 14:10:08.164158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 17/53] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:08 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:08.598956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:08.600806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:08.612966 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.613989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.616663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.618357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.618837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.622024 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.709251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:08.709930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:08.722655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.723754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.725294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.729771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.734973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.735834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.835468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:08.844777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c8a9151e-9711-4232-aec5-b2712f4495af tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1284 microversion: 2.1 time: 0.140230 Sep 15 14:10:08.845362 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 18/54] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:08 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:08.853416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:08.854244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:08.863072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.869980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.871935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.872862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:08.873480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:08.874063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:08.932467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:08.948544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96002a50-1bb4-453f-ab3d-11ee88170a2a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.357388 Sep 15 14:10:08.964736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 37/55] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:08 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:08.987010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:09.009599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:09.012701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:09.013824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-18e27194-26a1-4b4d-b2b1-be5b8e0a060a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.164184 Sep 15 14:10:09.014447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 19/56] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:08 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:09.177744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:09.178785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:09.194350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.195743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:09.197120 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:09.199852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.200554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:09.202175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:09.210323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:09.365951 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:09.377375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-664c0052-5e4a-48b7-b3d0-89af706eb90c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.205377 Sep 15 14:10:09.378508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 38/57] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:09 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:09.873225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:09.873927 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:09.887009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.888627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:09.890478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:09.891488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.894925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:09.895518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:09.973563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:09.974318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:09.985596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.986091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:09.986577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:09.998016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:09.999129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:10.000558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:10.074957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.100817 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fe52b674-ed25-4b53-a49a-5d370393548a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1284 microversion: 2.1 time: 0.230572 Sep 15 14:10:10.113338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 20/58] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:09 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:10.135514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:10.136592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:10.153781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:10.157400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:10.158302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:10.159941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:10.160713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:10.162314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:10.302870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.322766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e31fe027-442c-43e0-a4a3-415a6eb45bd3 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.353193 Sep 15 14:10:10.334816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 39/59] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:09 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:10.359003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.404255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:10.405028 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:10.414915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.418056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:10.419181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:10.420034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:10.420185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.423507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:10.424527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:10.424705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5f78a74b-c344-4e8c-b520-8ad77ace59da tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.301445 Sep 15 14:10:10.428208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 21/60] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:10 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:10.429873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:10.543419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:10.555751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d0c35b4b-8506-43a1-856b-e6bfb5cda4fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.155961 Sep 15 14:10:10.557594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 40/61] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:10 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:11.133707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:11.135600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:11.148255 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.149822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.150392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.151965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.154290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.154977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.291292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.310317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f3e5f57b-053b-4ec0-86f9-e040a4f4778b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1272 microversion: 2.1 time: 0.181474 Sep 15 14:10:11.311273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 22/62] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:11 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:11.350239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:11.350869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:11.377825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.378313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.378748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.379450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.394661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.395130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.459946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:11.462225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:11.476588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.477576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.478185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.479116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.479792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.480551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.660184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.673162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.675663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.679837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.682670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-927b3b5c-28cf-4608-a116-cabf90456802 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1284 microversion: 2.20 time: 0.229357 Sep 15 14:10:11.683615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 23/63] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:11 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:11.689685 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:11.690596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:11.697738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.698662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.699356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.702133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:11.704006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:11.704620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:11.709529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-887862ef-b46f-4aee-ba5f-de85eeb2351d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.337036 Sep 15 14:10:11.713388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 41/64] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:11 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:11.934888 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:11.951085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-efedc018-98fe-4d92-bf34-b501378ff71f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.260212 Sep 15 14:10:11.952002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 24/65] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:11 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:12.337475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:12.338460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:12.354321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.358630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.361143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.362208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.371084 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.371801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.713116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:12.714454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:12.717503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:12.726860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.731552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.732078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.733266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.733456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-386db721-875d-4618-b893-db496a0eb17a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.397627 Sep 15 14:10:12.735885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 42/66] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:12 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:12.740442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.742002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.743921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:12.746688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:12.761412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:12.764960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.767328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.767902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.768702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:12.769475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:12.771765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:12.783957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:13.187822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:13.204170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:13.212605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:13.213751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-22321de1-70ed-4818-b414-53bdafc7fd86 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1276 microversion: 2.20 time: 0.506214 Sep 15 14:10:13.219652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 25/67] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:12 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:13.236249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:13.240188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:13.263381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:13.264079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:13.264731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:13.268521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:13.270353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:13.270970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:13.548914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:13.572412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-de37e628-3a5b-4cec-9dda-ad664f277228 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1218 microversion: 2.1 time: 0.349859 Sep 15 14:10:13.595422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 26/68] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:13 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:13.761997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:13.762674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:13.779446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:13.783350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:13.786004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:13.788839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:13.792988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:13.794105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:13.888715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=8 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:13.934457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=24 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:14.195605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:14.213107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1b2ca6ac-7f36-4d41-8334-080700bc65e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 1.474729 Sep 15 14:10:14.216312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 43/69] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:12 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:14.255649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:14.256631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:14.264804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=24 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:14.287003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:14.290315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:14.291722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:14.295935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:14.298680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:14.299208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:14.651314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:14.669562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:14.681916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:14.688890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f5d4d46b-0b7a-494d-a716-4f9d7cefdb15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1276 microversion: 2.20 time: 0.436248 Sep 15 14:10:14.689637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 44/70] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:14 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1276 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:14.701431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:14.702794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:14.740646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:14.741694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:14.743849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:14.745236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:14.746740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:14.748639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:14.870590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:14.878987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-35d8040f-2244-47a5-b581-f8b3be3fd188 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 1.121346 Sep 15 14:10:14.885940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 27/71] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:13 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:15.191108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:15.201728 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2adcbdc8-b78a-43fc-b844-f55249808d08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1274 microversion: 2.1 time: 0.509925 Sep 15 14:10:15.239904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 45/72] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:14 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1274 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:15.248412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:15.249135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:15.256118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:15.256750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:15.257283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:15.258135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:15.258628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:15.259251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:15.615022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:15.638248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-86bffea7-2ad5-4756-8c75-f4f4555e7df5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.393316 Sep 15 14:10:15.651374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 28/73] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:15 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:15.719365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:15.720013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:15.739168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:15.739940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:15.740523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:15.741374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:15.741972 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:15.742525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:15.942619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:15.960274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:15.961754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:15.968059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2c14d633-545e-4eee-9606-dc73cb06824c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1276 microversion: 2.20 time: 0.251996 Sep 15 14:10:15.968899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 46/74] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:15 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:15.989520 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd08b47f-85ba-4a0c-9450-9ec3005732d5", "tag": "96de7222-ae08-4df9-8d02-8bde6a53ae43"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:16.004992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:16.010342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:16.025067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.026371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.026985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.027374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.029072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.031127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.033499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.036632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.038188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.097658 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Creating event network-changed:96de7222-ae08-4df9-8d02-8bde6a53ae43 for instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 on hv-cinder-85697 Sep 15 14:10:16.099149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 14:10:16.099851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32675a9a-0b9b-4998-9d84-40ef13276111 req-02fbad76-4690-4af3-ba3d-9a0518e39aac service nova] Acquired lock "compute-rpcapi-router" {{(pid=120647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 14:10:16.103724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.111922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.114135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.117311 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.119542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.121313 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.157516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.compute.rpcapi [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 14:10:16.158413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] Releasing lock "compute-rpcapi-router" {{(pid=120647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 14:10:16.179116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bbf73cfd-4695-4cb6-a573-c183ca758792 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392186 Sep 15 14:10:16.179746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 29/75] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:10:16.240864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:16.241816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:16.252376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.252865 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.253296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.255114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.257375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.259032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.378450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:16.390106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-02c828cb-de04-4a12-b5c8-f82caf71f23d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1274 microversion: 2.1 time: 0.153350 Sep 15 14:10:16.399171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 30/76] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:16 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:16.488999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:16.509642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c9ce3de4-d62f-4d91-99ca-140191159e9f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.508452 Sep 15 14:10:16.531978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 47/77] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:15 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:16.666704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:16.667704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:16.677583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.681569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.682445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.683333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:16.683819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:16.684248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:16.915628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:16.936914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6782ecd2-0847-441f-ad72-5faeab822303 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.273938 Sep 15 14:10:16.940864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 31/78] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:16 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:16.997598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:16.999041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:17.008471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.009160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.009589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.010287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.010740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.011156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.088638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:17.098659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:17.100123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:17.101204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9cc21269-200e-4c15-9160-ed951e2e162b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1276 microversion: 2.20 time: 0.109333 Sep 15 14:10:17.101816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 32/79] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:16 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:17.143005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7417b73e-2234-4215-95ab-040a71f66d6b", "tag": "e3f7891c-8d65-4cff-b08d-3a752660d65a"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:17.165245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.165814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.166119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.190034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Creating event network-changed:e3f7891c-8d65-4cff-b08d-3a752660d65a for instance 7417b73e-2234-4215-95ab-040a71f66d6b on hv-cinder-85697 Sep 15 14:10:17.190785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 14:10:17.191324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-a165b005-24d3-4ea0-b98f-79a4fd0db24c req-8716e29a-05bd-4bfd-b22b-2e557768478b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 14:10:17.192547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.193146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.193725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.194598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.195041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.195608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.206251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.compute.rpcapi [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 14:10:17.207315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 14:10:17.224527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e0400a2c-f8c7-461c-95a8-deaaf9ca4df2 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304640 Sep 15 14:10:17.225111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 48/80] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:10:17.423841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:17.427208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:17.446047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.451612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.453337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.458050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.459453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.459987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.538411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:17.539215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:17.551062 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.556040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.557910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.563118 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.567945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.571356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.665407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:17.677970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a91e1074-6aa4-473c-a070-83e6b3f1a59a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1292 microversion: 2.1 time: 0.266134 Sep 15 14:10:17.687751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 33/81] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:17 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1292 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:17.965642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:17.966509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:17.985333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.987124 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.993282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:17.997955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:17.998592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:17.998865 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:18.255820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:18.282366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ac73496e-5556-4134-9c2a-4eadd5c62bd6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.745143 Sep 15 14:10:18.287781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 49/82] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:17 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:18.299583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:18.302241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:18.323200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:18.326625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:18.327399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:18.328927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:18.349974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:18.355619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:18.565793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:18.579983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:18.581793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:18.584939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:18.589711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-10e9674b-8629-4aea-aaea-e8c6811c6ec0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1332 microversion: 2.20 time: 0.297739 Sep 15 14:10:18.591254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 50/83] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:18 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1332 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:18.599412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a6f0fbe5-1b1a-48ad-b44f-a5687a147915 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.637757 Sep 15 14:10:18.601460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 34/84] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:17 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:18.702133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:18.703217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:18.713588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:18.714415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:18.719794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:18.720788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:18.721519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:18.722607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:18.990811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:19.022794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ab35709b-57ae-4c1c-99e8-e36a9b84d34b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1280 microversion: 2.1 time: 0.313883 Sep 15 14:10:19.023492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 51/85] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:18 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:19.315728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:19.316980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:19.330342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.333108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.333787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.334768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.336651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.339076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.621515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:19.622401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:19.629396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.630294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.630877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.631769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.632368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.633049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.730654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:19.748737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:19.754108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:19.755647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-28e9f2ef-a9a6-4f6c-b6b4-2cf245e1fa27 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1338 microversion: 2.20 time: 0.137953 Sep 15 14:10:19.762557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 52/86] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:19 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:19.778185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:19.780481 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:19.788194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.788803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.789324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.790059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:19.790565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:19.791206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:19.993436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.005247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-91aeef46-dff4-4a4b-848a-ec958f17c897 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.692880 Sep 15 14:10:20.005794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 35/87] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:19 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:20.015573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27d1fdf-b409-467e-9b03-2a2d60ca01f8", "tag": "6b330db3-4b2e-4089-b147-9c293a9a00a3"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:20.038782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:20.039261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:20.039710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:20.065680 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] Creating event network-changed:6b330db3-4b2e-4089-b147-9c293a9a00a3 for instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 on hv-cinder-85697 Sep 15 14:10:20.073102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d2654c60-a528-45d2-b740-b449988f7327 req-082b2b08-8031-4178-8e44-d04f6232bda3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063536 Sep 15 14:10:20.081343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 36/88] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:10:20.091757 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:20.092728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:20.103172 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:20.104001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:20.104716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:20.106520 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:20.107179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:20.108145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:20.223829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.231474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-365b8fc3-475f-4bf3-b5c0-9c58cf034472 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.467513 Sep 15 14:10:20.244585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 53/89] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:19 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:20.497640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.509446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-192b4342-5b7d-4a78-8b36-4500f4938884 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.426022 Sep 15 14:10:20.510197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 37/90] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:20 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:20.785362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:20.786180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:20.792427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:20.792995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:20.793501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:20.794290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:20.794833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:20.795470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:20.933470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.942523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.943982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:20.945079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e54cf424-b77e-404a-ac9f-29d8d85fbab0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.164256 Sep 15 14:10:20.945647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 54/91] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:20 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:21.032012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:21.032620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:21.038593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.039070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.039499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.040224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.040835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.041384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.173001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:21.180480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-15d4cbeb-6c5b-4498-b4b5-173b0eb91c89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.152641 Sep 15 14:10:21.181062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 38/92] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:21 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:21.259371 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:21.259998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:21.265778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.266245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.266665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.267342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.267818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.268232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.272101 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:21.394258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:21.401781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eef346e9-e0bc-40b0-aea5-dab9fd921893 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.146190 Sep 15 14:10:21.402348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 55/93] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:21 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:21.534588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:21.535317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:21.541272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.541755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.542184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.542863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.543309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.543748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.678076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:21.688347 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1bcc9258-9aec-4bd8-846c-7ff66af6aec3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.156393 Sep 15 14:10:21.688952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 39/94] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:21 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:21.970430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:21.971052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:21.977068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.977551 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.977985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:21.978672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:21.979126 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:21.979549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.112347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.120519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.121938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.123102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9e9641e4-2bee-4210-ade3-c0481130345d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.156613 Sep 15 14:10:22.123650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 56/95] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:21 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:22.203912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:22.204561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:22.210442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.210921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.211352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.212071 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.212521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.212938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.343021 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.351205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c03c39d1-d5a9-4153-8cca-614df8533a2f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.151271 Sep 15 14:10:22.351789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 40/96] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:22 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:22.425150 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:22.425753 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:22.431712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.432216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.432912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.433592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.434093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.434446 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.558636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.566372 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f6180358-69d1-427e-bfe1-74b630c1096b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.145742 Sep 15 14:10:22.566939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 57/97] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:22 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:22.711360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:22.712020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:22.717815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.718557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.719555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.720289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:22.720757 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:22.721164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:22.849056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:22.856467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-301176d5-95f3-46b3-a922-6fc546996795 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.148893 Sep 15 14:10:22.857028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 41/98] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:22 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:23.148553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:23.149146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:23.155097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.155571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.156033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.156722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.157165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.157579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.286732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:23.294793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:23.296257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:23.297628 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f7b95420-f6ad-4ef6-baa5-eba3c68c8a6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.152973 Sep 15 14:10:23.298205 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 58/99] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:23 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:23.375725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:23.376252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:23.382191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.382674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.383110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.383827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.384282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.384710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.509552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:23.513030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:23.518146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-38793e0e-a1c5-471b-8801-1017744a539c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.146927 Sep 15 14:10:23.518711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 42/100] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:23 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:23.588663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:23.589268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:23.595282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.595799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.596242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.596923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.597370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.597789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.725248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:23.732783 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd702961-4424-4120-a1dc-870caa966738 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.148004 Sep 15 14:10:23.733353 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 59/101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:23 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:23.878846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:23.879463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:23.885281 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.885758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.886189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:23.886867 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:23.887319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:23.887759 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.016699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.024114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4db2b546-1f0e-459b-82ac-8c058fbef8df tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.149159 Sep 15 14:10:24.024673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 43/102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:23 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:24.323329 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:24.323962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:24.330438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.330907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.331330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.332048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.332495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.332910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.457443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.465505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.466872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.467990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b00ad17d-0dd6-4c2b-9231-46721821c545 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.148610 Sep 15 14:10:24.469416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 60/103] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:24 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:24.540522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:24.541130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:24.546932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.547585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.548051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.548738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.549191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.549612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.679899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.688264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-41178415-d590-42bb-af67-d1fe0b270232 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.151535 Sep 15 14:10:24.688828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 44/104] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:24 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:24.757300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:24.757907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:24.763837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.764319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.764744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.766209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:24.766661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:24.767078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:24.908497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:24.916733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2880c685-a36e-4f70-b235-c3e582a69b1f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.163254 Sep 15 14:10:24.917310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 61/105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:24 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:25.047436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:25.047988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:25.053935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.054406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.054832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.055504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.055986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.056407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.185695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:25.193758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4359c964-ebbf-4fb2-8fb7-959c1d2b65c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.150350 Sep 15 14:10:25.194353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 45/106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:25 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:25.494320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:25.494924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:25.501425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.501899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.502330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.503009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.503459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.503907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.629266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:25.637249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:25.638690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:25.639813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-08fca6fe-09f3-4c60-9d7a-b64617ae8ef5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.149348 Sep 15 14:10:25.640421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 62/107] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:25 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:25.711129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:25.711763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:25.717485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.717957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.719390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.720308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.720744 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.721165 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.942093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:25.942917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:25.954396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.955011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.955461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:25.956774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:25.957238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:25.957667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:26.138391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:26.733366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:26.745735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0c99f483-87cd-40e9-9e85-8c29b1bad748 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.807627 Sep 15 14:10:26.746834 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 63/108] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:25 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:26.753540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:26.760965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:26.770794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:26.778408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:26.778924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:26.779659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:26.780158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:26.780574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:26.801431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:26.818713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-78d18acb-84bb-4f4d-a5c3-db57bc81377b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 1.111188 Sep 15 14:10:26.833319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 46/109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:25 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:26.847346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:26.848422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:26.860341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:26.860830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:26.865298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:26.866259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:26.866731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:26.867172 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.118782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:27.130130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c286810a-5f59-47b4-9f5b-4888ed198b66 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.382112 Sep 15 14:10:27.130994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 64/110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:26 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:27.204342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:27.218264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:27.220273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:27.221397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8847bc62-0ede-4319-b316-8267c66a617e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.386802 Sep 15 14:10:27.229178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 47/111] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:26 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:27.427174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93bb208e-87b2-4a1d-aadd-6c494d83d01f", "tag": "37409932-0575-4016-bb98-a4f28388af35"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:27.433618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:27.441144 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.442081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.442637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.456281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] Creating event network-changed:37409932-0575-4016-bb98-a4f28388af35 for instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f on hv-cinder-85697 Sep 15 14:10:27.461504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-98877889-9728-48d4-ba79-aa20cfa29858 req-14e006f0-1ea5-4256-b07e-c9839292f0c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038775 Sep 15 14:10:27.462394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 65/112] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:10:27.602864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:27.619197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.620395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.621783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.642909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] Creating event network-changed:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:10:27.664574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-54f4b564-3e7c-4736-bc03-dc445862ee81 req-ca1d452a-6453-462e-aee7-3a82f2f0abc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064539 Sep 15 14:10:27.666102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 48/113] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:10:27.778507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:27.790630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:27.807621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.808726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.809905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.811427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.813760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.817722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.849935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:27.850625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:27.857200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.857688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.858127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.858916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:27.860032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:27.860460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:27.980473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:27.988886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b298ec2e-b270-49cb-a7dc-02246405ac09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.221564 Sep 15 14:10:27.989465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 66/114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:27 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:28.037822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:28.045314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8792b665-ffc4-4a27-be86-fe3a13fb3a1f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.199508 Sep 15 14:10:28.045881 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 49/115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:27 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:28.153633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:28.154241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:28.160590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:28.161072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:28.161491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:28.162169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:28.162613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:28.163032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:28.250221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:28.251082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:28.256947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:28.257490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:28.258110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:28.258800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:28.259286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:28.259668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:28.362708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:28.370610 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1a17cd40-97fe-42b9-be9c-55f6a3b2838d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.220849 Sep 15 14:10:28.371194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 67/116] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:28 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:28.422145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:28.431847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:28.433825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:28.434973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dd5dcdb5-a737-4f78-bb5b-587582b0beb8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.189223 Sep 15 14:10:28.435536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 50/117] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:28 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:29.013282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:29.013944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:29.020841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.021320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.021741 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.022417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.022856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.023265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.068585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:29.069216 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:29.075241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.075756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.076193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.076886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.077338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.080125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.209739 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.220131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b1174ca3-5214-4417-baf6-7a4e4e77c364 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.210601 Sep 15 14:10:29.221075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 68/118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:29 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:29.239932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.247422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f08196a3-198d-4274-b898-90c74a32e33d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.182662 Sep 15 14:10:29.248027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 51/119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:29 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:29.394302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:29.394995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:29.400877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.401439 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.401869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.402546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.402992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.403522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.461079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:29.461822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:29.468447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.469045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.469745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.470501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:29.471010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:29.471640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:29.551588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.561917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6e6870f8-462e-4260-95f8-3781953b8043 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.171271 Sep 15 14:10:29.563745 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 69/120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:29 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:29.610414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.618512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.619962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:29.621060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-77a94d53-a9fb-4f42-97a9-60c9a9300f11 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.163899 Sep 15 14:10:29.621621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 52/121] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:29 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:30.242152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:30.242881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:30.248833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.249998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.250511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.251205 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.251656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.252095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.270335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:30.270940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:30.276926 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.277409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.277841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.278646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.279097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.279724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.395492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.406814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-62df1176-95d5-4cb5-85b0-ab704312a54d tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.168227 Sep 15 14:10:30.407406 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 70/122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:30 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:30.429614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.438392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7e7aad9a-4f4e-4d37-8f23-719fd74fcc0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.171744 Sep 15 14:10:30.438989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 53/123] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:30 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:30.594243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:30.594243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:30.596849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.597328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.597759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.598431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.598868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.599279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.649489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:30.650312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:30.663013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.667106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.667637 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.668654 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:30.669189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:30.669691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:30.746476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.760693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9a7f5d01-59f8-4d69-a516-231e2e5dc1d1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.175195 Sep 15 14:10:30.761282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 71/124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:30 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:30.897644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.909957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.911652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:30.913050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4608f6c1-78b4-46bd-956a-44b713534ae1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.267274 Sep 15 14:10:30.913549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 54/125] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:30 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:31.430134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:31.430734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:31.436880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.437662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.438099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.438776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.439223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.439634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.459660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:31.461557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:31.462459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:31.468808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.469284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.469713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.470397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.470841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.472244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.574500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:31.582283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b99c055f-6ed0-498f-8aac-0e5af5943a39 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.156057 Sep 15 14:10:31.582858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 72/126] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:31 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:31.607425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:31.615589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-53b0c9b8-4bb8-41c2-a7bf-46a472542392 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.158190 Sep 15 14:10:31.616196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 55/127] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:31 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:31.787248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:31.787887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:31.793740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.794215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.794642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.795321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.795806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.796223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.923912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:31.931553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-114acfac-1b30-4394-9845-f07c00198510 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.148201 Sep 15 14:10:31.932174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 73/128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:31 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:31.939248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:31.939955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:31.946319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.947000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.947664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:31.948573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:31.949056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:31.949704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.082977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:32.090934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:32.092410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:32.094118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a7d2a56a-e61a-4c7d-b80a-e43b088972aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.159002 Sep 15 14:10:32.094836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 56/129] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:31 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:32.605029 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:32.605643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:32.612223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.612702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.613133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.613810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.614261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.614678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.638325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:32.638986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:32.644833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.645315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.645756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.646440 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.646894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.647317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.745801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:32.754444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a36d5379-aa24-45b4-a127-65c0208c7809 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.153251 Sep 15 14:10:32.755025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 74/130] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:32 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:32.783576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:32.791181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2064bb76-2f86-446b-97b4-dd2297659ceb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.156655 Sep 15 14:10:32.791760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 57/131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:32 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:32.954710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:32.955242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:32.961158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.961635 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.962559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:32.963243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:32.963712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:32.964135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.091672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.099280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e86de54f-05bb-4dde-9804-6ce2025644c4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.149020 Sep 15 14:10:33.099867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 75/132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:32 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:33.118141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:33.118736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:33.125565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.126037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.126459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.127130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.127574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.128034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.259422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.267431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.268891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.269976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ee482851-f76a-496a-9699-7bc8918c679d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.155641 Sep 15 14:10:33.270538 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 58/133] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:33 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:33.777445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:33.778027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:33.784511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.784983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.785403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.786081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.786527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.786941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.814302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:33.814903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:33.821382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.821854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.822278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.822953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:33.823396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:33.823837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:33.919852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.928533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8db42c6a-d02c-4471-97ef-bd3a1f31fa61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.155041 Sep 15 14:10:33.929396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 76/134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:33 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:33.953292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:33.960951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-817a0605-8249-452e-9583-729268c92f73 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.150688 Sep 15 14:10:33.961509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 59/135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:33 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:34.121068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:34.121615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:34.128359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.128832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.129262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.129939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.130386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.130801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.259318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:34.267677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f062d2d2-4d5e-4396-ade8-4b90eec38fd9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.150465 Sep 15 14:10:34.269016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 77/136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:34 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:34.294140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:34.294827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:34.300923 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.301413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.301847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.302537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.302990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.303407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.307836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:34.435258 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:34.444234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:34.445668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:34.446753 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e642c075-b1b5-467b-a1fe-a7d486899f61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.156421 Sep 15 14:10:34.447311 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 60/137] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:34 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:34.952336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:34.953605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:34.959805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.960286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.960718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.961401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.961881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.962302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.982571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:34.983179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:34.989031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.989510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.989941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:34.990623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:34.991070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:34.991486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:35.090305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.098537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-645f735e-d4f7-4826-b39b-4d1770420fde tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.150036 Sep 15 14:10:35.099116 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 78/138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:34 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:35.126135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.133762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dce8c6b7-b01f-43ae-8aef-537b9b38078d tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.154958 Sep 15 14:10:35.134339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 61/139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:34 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:35.290058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:35.290674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:35.296477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:35.296954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:35.297414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:35.303215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:35.303215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:35.303215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:35.436708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.444988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cac2f95c-e066-43e6-837a-5a85630c7356 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.158656 Sep 15 14:10:35.445579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 79/140] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:35 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:35.472141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:35.472746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:35.478521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:35.479002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:35.479435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:35.480154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:35.480606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:35.481033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:35.605098 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.613577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.615022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:35.616146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0e9db4ba-be0b-4235-b88d-b6ce28ea5a93 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.147876 Sep 15 14:10:35.616706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 62/141] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:35 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:36.121085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:36.121679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:36.128354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.128828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.129249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.129920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.130361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.130774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.156433 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:36.157041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:36.158943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:36.164376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.164853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.165280 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.165965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.166404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.166814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.260834 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.269148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-911ef79d-0470-4652-8a62-2f1a5a0d7af4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.151806 Sep 15 14:10:36.269726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 80/142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:36 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:36.300006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.307792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-684b0097-c065-4348-a082-b4266f6ef02c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.155228 Sep 15 14:10:36.308358 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 63/143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:36 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:36.467661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:36.468354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:36.474502 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.475007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.475467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.476191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.476643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.477067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.607978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.616156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-88849e3d-226c-48f1-bed7-8853616bbc10 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.152254 Sep 15 14:10:36.616725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 81/144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:36 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:36.640842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:36.641439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:36.647400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.647900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.648321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.648993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:36.649433 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:36.649850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:36.783644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.791448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.792979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:36.794064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ce080c99-c8f3-4344-98fa-c58d8f8a87c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.157139 Sep 15 14:10:36.794704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 64/145] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:36 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:37.292550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:37.293473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:37.300366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.300855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.301285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.301978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.302435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.302856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.332024 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:37.333243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:37.346458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.347057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.347607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.348422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.348972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.349540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.472671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.486261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-799135b2-41f4-418f-8ad5-5af642ab25ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.198453 Sep 15 14:10:37.488865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 82/146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:37 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:37.588128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.599645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-57c26f64-28cc-4d7d-bb87-0a3ae945ccf2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.272038 Sep 15 14:10:37.600565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 65/147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:37 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:37.629483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7417b73e-2234-4215-95ab-040a71f66d6b", "name": "network-vif-plugged", "status": "completed", "tag": "e3f7891c-8d65-4cff-b08d-3a752660d65a"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:37.640805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.641468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:37.642303 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:37.642552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.643052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.648427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.648964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.649588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.650648 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.651253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.652673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.655179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] Creating event network-vif-plugged:e3f7891c-8d65-4cff-b08d-3a752660d65a for instance 7417b73e-2234-4215-95ab-040a71f66d6b on hv-cinder-85697 Sep 15 14:10:37.661651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-3633a4b0-68d5-4a0a-bc10-06c5e600cf1d req-7c323aaf-1e2d-4e35-ad33-c7e66f3edc6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106021 Sep 15 14:10:37.663970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 83/148] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:10:37.807295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.819710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-df4239ad-2cd5-47fb-8ba4-7f1ce639c813 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.184527 Sep 15 14:10:37.820362 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 66/149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:37 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:37.820512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:37.821112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:37.827892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.828533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.828963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.829666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:37.830148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:37.830575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:37.980649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.989396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.990846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:37.991957 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-569e8318-a7ee-4a46-bbc3-2f7f815af265 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.176136 Sep 15 14:10:37.992515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 84/150] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:37 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:38.513518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:38.514395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:38.524483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.524976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.525421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:38.526123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.526760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.527050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:38.623797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:38.625009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:38.632377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.633067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.633670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:38.634508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.635089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.635653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:38.717884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:38.726788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-11ec5e44-e2ad-448f-a581-b7586fe2bae1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.220665 Sep 15 14:10:38.727829 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 67/151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:38 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:38.818407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:38.827835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-766f16c7-fce2-4fae-87ca-e5ef2b6cb88b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.207209 Sep 15 14:10:38.828792 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 85/152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:38 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:38.845454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:38.846168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:38.859593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.859593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.859593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:38.859593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:38.860214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:38.860214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.019432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:39.020456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:39.028208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.029127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.029829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.031296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.032361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.033338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.063746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:39.087890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9484a9fb-0987-4806-a050-9a2634cfd016 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.234740 Sep 15 14:10:39.087890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 68/153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:38 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:39.276015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:39.291239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:39.294268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:39.301567 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11dc48a5-3e20-40ba-a375-dc21e887ced2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.281684 Sep 15 14:10:39.304125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 86/154] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:39 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:39.751387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:39.752157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:39.759130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.759612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.760070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.760990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.761522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.762010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.851719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:39.852325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:39.866484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.866959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.867509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:39.868315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:39.868762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:39.869206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:40.022943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:40.038421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4cd22de1-a996-4177-9e1f-412835b05e10 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.292683 Sep 15 14:10:40.044512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 69/155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:39 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:40.107220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:40.108100 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:40.116323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:40.121458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:40.122198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:40.123853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:40.125231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:40.140153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:40.387719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:40.396719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72f348df-0691-41e5-9754-49b9d733fb3e tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.549005 Sep 15 14:10:40.397673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 87/156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:39 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:40.402445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:40.403222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:40.409766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:40.410475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:40.411063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:40.412043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:40.412643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:40.413305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:40.829095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:40.838825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a9e73663-91d8-441a-9ba2-49f1c1d113f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.735336 Sep 15 14:10:40.843648 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 70/157] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:40 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:41.078626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:41.079353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:41.085689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.087138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.087597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.088353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.088822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.089241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.301081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:41.311249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:41.320851 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:41.326102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f45f05e-c4e0-4ee6-abac-25de18b38bb4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.924407 Sep 15 14:10:41.328563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 88/158] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:40 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:41.422419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:41.425362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:41.438609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.439646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.442517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.444649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.445949 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.449937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.705416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:41.718969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c3e98d4c-bfa6-4d3e-bcf6-945fd1cb9b2c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.642376 Sep 15 14:10:41.720179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 71/159] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:41 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:41.763455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd08b47f-85ba-4a0c-9450-9ec3005732d5", "name": "network-vif-plugged", "status": "completed", "tag": "96de7222-ae08-4df9-8d02-8bde6a53ae43"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:41.802729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.805494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.806570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.841952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] Creating event network-vif-plugged:96de7222-ae08-4df9-8d02-8bde6a53ae43 for instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 on hv-cinder-85697 Sep 15 14:10:41.870268 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-8ce8f0b0-506b-492e-8179-6c0822bbff85 req-aac925fd-7df3-471b-8a22-5e2b8dce7d94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113349 Sep 15 14:10:41.875850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 72/160] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:10:41.895888 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:41.899484 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:41.927939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.930212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.931475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.933164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:41.947385 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:41.954853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:41.956869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:41.964750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:41.982411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e04e7fc5-f72d-4a38-8af0-afe89ca47e26 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.563851 Sep 15 14:10:41.987525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 89/161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:41 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:42.358626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:42.359633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:42.371671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:42.372441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:42.373017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:42.373933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:42.374765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:42.382720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:42.395431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:42.411396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d9b07828-e8bf-4569-9ae5-bf365e7530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.533493 Sep 15 14:10:42.412524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 73/162] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:41 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:42.576714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:42.587551 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:42.589300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:42.590397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4847d47d-8496-42f7-8178-5ecd83874ca2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.235695 Sep 15 14:10:42.590973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 90/163] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:42 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:42.742522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:42.743231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:42.752577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:42.753001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:42.753673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:42.757939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:42.758420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:42.758850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.039963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:43.045794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:43.057254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=95 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:43.062418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.063745 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.064480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.065522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.066133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.066709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.197044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.210041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-78f728a6-ba69-4fcb-8d19-5597813b540e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.471575 Sep 15 14:10:43.211959 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 74/164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:42 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:43.414323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.428650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-66b2176e-449a-47ba-a7fa-a8ee6080ab41 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.397374 Sep 15 14:10:43.430907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 91/165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:43 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:43.440629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:43.441546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:43.462776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.466690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.467354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.468373 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.472137 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.472653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.618043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:43.618512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:43.638633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.641458 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.641907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.646998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.647474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.647926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.810355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.828942 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-73f55331-e5a6-4a06-8b65-cb700dd84544 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.394734 Sep 15 14:10:43.838222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 75/166] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:43 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:43.894935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27d1fdf-b409-467e-9b03-2a2d60ca01f8", "name": "network-vif-plugged", "status": "completed", "tag": "6b330db3-4b2e-4089-b147-9c293a9a00a3"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:10:43.900704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.915708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.917092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:43.917522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:43.917645 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:43.917956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:43.919043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1a0e9b40-7e3d-4993-9d09-e46186499061 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.306491 Sep 15 14:10:43.919888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 92/167] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:43 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:43.947629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] Creating event network-vif-plugged:6b330db3-4b2e-4089-b147-9c293a9a00a3 for instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 on hv-cinder-85697 Sep 15 14:10:43.954559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-8f7a1efe-4533-42bd-b4c3-fa8ffdad1ffc req-b3eaae1b-176b-4fd9-9be0-ce98ff70ef40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063427 Sep 15 14:10:43.955171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 76/168] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:10:44.236574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:44.238097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:44.244734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.245414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.245844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.246691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.247346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.247977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.415539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:44.426349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-39297dd7-7597-4730-a8a0-9f84a5c9e784 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.195081 Sep 15 14:10:44.439708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 93/169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:44 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:44.461454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:44.462152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:44.469393 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.469890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.470511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.471618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.472406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.472840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.624404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:44.631936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-740eb242-98e1-4353-b33c-818ac25efb96 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.175477 Sep 15 14:10:44.632522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 77/170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:44 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:44.853249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:44.854393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:44.861321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.862332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.862880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.863599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.864352 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.864774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.945458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:44.946063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:44.954886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.955619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.958583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.960573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:44.961540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:44.962155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:44.968208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:45.033959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.045283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5db3fe7c-c7d4-4d75-afbf-3aa8eb8ac478 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.196009 Sep 15 14:10:45.045886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 94/171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:44 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:45.118895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.127508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.129737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.130966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2c1441b2-2a51-4093-b751-67d917936c74 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.189545 Sep 15 14:10:45.131742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 78/172] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:44 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:45.450141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:45.450747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:45.457390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:45.457816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:45.458261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:45.458944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:45.459396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:45.459835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:45.597156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.604914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-deddc716-daf3-459f-9427-d33e23bc0ee0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.158568 Sep 15 14:10:45.605837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 95/173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:45 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:45.654135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:45.654766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:45.661240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:45.661719 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:45.662146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:45.662838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:45.663288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:45.663748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:45.794287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:45.802469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-07583935-7c7a-4f58-860e-b976be81b7d2 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.152071 Sep 15 14:10:45.803040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 79/174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:45 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:46.068360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:46.068967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:46.075021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.075506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.075992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.076680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.077129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.078074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.157492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:46.158160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:46.164269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.164788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.165220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.165921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.167712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.167712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.261974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:46.272473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-133f74c1-3973-42b2-9423-ef40876afe59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.207861 Sep 15 14:10:46.273094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 96/175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:46 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:46.330236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:46.339728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:46.341010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:46.342251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-43fadec9-c8d4-4010-9c9b-f05877b10fe6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.189590 Sep 15 14:10:46.343787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 80/176] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:46 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:46.628036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:46.628739 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:46.634646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.635202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.635727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.636472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.637012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.637435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.826003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:46.826611 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:46.832982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.833571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.834075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.835048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:46.835870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:46.836607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:46.845432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:46.863815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bd13d002-670a-4db8-869d-dd892ae050ac tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.240131 Sep 15 14:10:46.879879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 97/177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:46 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:46.990306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:47.000768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9a5b8b59-ab0b-4602-ac46-5d523be712eb tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.178386 Sep 15 14:10:47.002041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 81/178] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:46 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:47.296956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:47.297574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:47.303625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.304132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.304562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:47.305470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.306082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.306506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:47.367883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:47.368500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:47.375056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.375644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.376272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:47.376978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.377552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.377838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:47.495550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:47.503722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7bceb78d-c591-4fbb-9080-2b014b58fa0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.211045 Sep 15 14:10:47.504368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 98/179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:47 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:47.515933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:47.524706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:47.526154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:47.527262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d80cd656-fd9a-4d75-b8d7-adf8e6af9e2d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.163295 Sep 15 14:10:47.528057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 82/180] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:47 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:47.890828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:47.891793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:47.898143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.898635 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.899071 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:47.899800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:47.900264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:47.900689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.025429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:48.026034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:48.033068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.033560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.033991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.034690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.035144 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.035558 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.038893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.046924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-022b7b7f-a514-4777-9c33-85f9a8133e2b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.163640 Sep 15 14:10:48.048388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 99/181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:47 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:48.180378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.191155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8a756707-d970-4342-a9e5-6e36911be499 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.169460 Sep 15 14:10:48.191759 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 83/182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:48 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:48.526672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:48.527283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:48.533229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.533708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.534136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.534819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.535328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.535673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.556039 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:48.556039 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:48.560051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.560592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.561082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.563459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:48.564004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:48.564489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:48.673612 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.684464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-956f2a58-d327-4cc7-8e39-0cb930babc24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.161491 Sep 15 14:10:48.685038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 100/183] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:48 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:48.705230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.713208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.714651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:48.715861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-33f00c83-8e93-41b3-b4d5-af24fac1b1de tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.166488 Sep 15 14:10:48.716498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 84/184] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:48 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:49.072881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:49.073605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:49.083788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.084434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.084896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.085707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.086197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.086634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.214273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:49.215543 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:49.223727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.231255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-683ff287-69d1-4e09-a57e-ff04830646bd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.162312 Sep 15 14:10:49.231835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 101/185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:49 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:49.234413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.234966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.235464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.236187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.236636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.237051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.367919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.376006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-415adbce-4b9a-4a59-be58-2cd1586b17a5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.165535 Sep 15 14:10:49.376576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 85/186] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:49 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:49.707227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:49.707867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:49.713767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.714243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.714672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.715350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.715915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.716335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.747091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:49.748007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:49.756633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.757199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.757692 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.758497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:49.759006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:49.759486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:49.863328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.870983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6ee63119-157d-495f-8614-2b2f65c83442 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.168824 Sep 15 14:10:49.871556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 102/187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:49 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:49.898204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.908104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.909555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:49.910706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6e0cb0af-1c66-4671-bda4-dd842941d85c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.168295 Sep 15 14:10:49.911262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 86/188] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:49 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:50.260211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:50.260211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:50.263776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.265655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.266720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.267843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.268520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.269061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.403337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:50.403337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:50.408350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.408733 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.409184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.410031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.410496 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.410918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.431212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:50.440999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7dfa6aaf-b0de-460b-8e29-4e097eb9a94a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.189352 Sep 15 14:10:50.441866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 103/189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:50 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:50.560142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:50.569357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4595ec63-dcf8-43ee-9c02-470f23080ea6 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.174838 Sep 15 14:10:50.570156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 87/190] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:50 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:50.894637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:50.895159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:50.901086 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.901561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.901992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.902668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.903117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.903536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.938417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:50.939016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:50.945740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.946265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.946873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:50.947574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:50.948046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:50.948466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:51.035332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.043025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c0868e5a-1294-47a3-8cd4-e2d1e14d7d16 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.153084 Sep 15 14:10:51.043600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 104/191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:50 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:51.083426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.092737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.095500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.096671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a8e5a21e-cfab-47a5-a216-202c86e96037 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.162662 Sep 15 14:10:51.097230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 88/192] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:50 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:51.470463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:51.470463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:51.475640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:51.476144 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:51.476691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:51.477622 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:51.478454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:51.478701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:51.592550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:51.594146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:51.600141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:51.600740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:51.601276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:51.602031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:51.602699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:51.603357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:51.626457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.635125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9592dd2d-2a7f-46a0-aff8-835a6b994b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.172417 Sep 15 14:10:51.648132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 105/193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:51 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:51.759245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:51.767807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d5c9efca-f49a-4586-aaaa-39fd9dd28d0a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.179151 Sep 15 14:10:51.768373 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 89/194] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:51 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:52.067103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:52.067725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:52.074833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.075666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.076419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.077684 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.078510 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.078934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.102509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:52.121765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:52.122525 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:52.129627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.130210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.130715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.131490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.132044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.132560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.242699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.250857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-84d47758-3608-4640-9aff-42751b958fc8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.188138 Sep 15 14:10:52.251448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 106/195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:52 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:52.294279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.305858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.307299 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.308718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-abc658bc-b117-44f3-a27d-4f6959032021 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.190728 Sep 15 14:10:52.309285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 90/196] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:52 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:52.661769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:52.662365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:52.668518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.668996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.669424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.670102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.670593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.671156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.790198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:52.790809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:52.803722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.804228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.804662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.805569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:52.806020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:52.806610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:52.819297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.830214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0501d068-d5b2-4ac8-9d8e-5f3a8d0d7574 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.172221 Sep 15 14:10:52.830786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 107/197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:52 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:52.944752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:52.952601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c66b41ff-6a20-49a8-8dfd-bf11db5541ac tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.166146 Sep 15 14:10:52.953265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 91/198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:52 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:53.278264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:53.278884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:53.285405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.285887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.286318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.287046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.287577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.288035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.339591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:53.340229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:53.346810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.347293 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.347747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.348449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.348902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.349321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.419910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:53.428407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2a6526c9-c6c1-493f-8a67-243a39567a4e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.153987 Sep 15 14:10:53.428988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 108/199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:53 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:53.480959 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:53.490788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:53.492245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:53.493348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fdfcea78-a4f2-44d8-bfff-61c69442dcb3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.157739 Sep 15 14:10:53.493914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 92/200] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:53 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:53.853863 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:53.854483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:53.861475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.861959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.862689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.863298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.863772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.864358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.976367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:53.977142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:53.982807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.983295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.983758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:53.984445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:53.984897 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:53.985320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:54.010796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.018990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-472b676c-bcc3-4f79-a2a6-83f65cde7e64 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.169815 Sep 15 14:10:54.019568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 109/201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:53 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:54.119042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.127800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-99624869-f17d-444d-831e-700a8e48460f tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.155055 Sep 15 14:10:54.128402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 93/202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:53 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:54.450884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:54.451392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:54.457421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:54.457904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:54.458333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:54.459022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:54.459472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:54.459919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:54.518869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:54.519477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:54.525578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:54.526094 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:54.526536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:54.527236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:54.528307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:54.528307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:54.595856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.604527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eaf618de-aa7d-4194-a23f-eba4675bc91b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.157504 Sep 15 14:10:54.605218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 110/203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:54 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:54.663530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.666890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:10:54.672253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.673676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:54.674771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c6ce394e-a989-4372-a026-b9933f884bd7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.159834 Sep 15 14:10:54.675329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 94/204] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:54 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:55.041520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:55.042167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:55.048846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.049336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.049763 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.050460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.050912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.051332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.151468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:55.151989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:55.158366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.158841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.159266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.159973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.160421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.160838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.188103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.195876 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b300ab3a-476b-4ef0-a0ef-d9884eecbfa6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.158298 Sep 15 14:10:55.196454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 111/205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:55 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:55.295898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.303805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0237b396-4540-472b-b658-76d9e629da22 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.156255 Sep 15 14:10:55.304382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 95/206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:55 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:55.627143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:55.627781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:55.634197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.634686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.635117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.635850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.636306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.636722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.709682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:55.710760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:55.716869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.717614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.718540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.719617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:55.720111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:55.720531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:55.797226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.806354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a4aa1c4e-a9f0-43ee-a9ac-5838a3056bc6 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.183867 Sep 15 14:10:55.807403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 112/207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:55 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:55.879659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.888216 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.890485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:55.891678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7ec1f3a0-dd17-4b15-89a5-31ee5b616500 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.194647 Sep 15 14:10:55.891678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 96/208] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:55 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:56.221357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:56.221950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:56.228047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.228520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.228944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.229618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.230063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.230476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.329023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:56.329799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:56.335461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.335964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.336390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.337073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.337518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.337939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.363005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:56.370590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f491e2cb-6843-4b38-8811-cdcc47b9aeb2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.153193 Sep 15 14:10:56.371163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 113/209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:56 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:56.474903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:56.482744 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-41b3ada5-4118-4392-839c-e2432f9cd7d1 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.159365 Sep 15 14:10:56.483844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 97/210] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:56 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:56.830336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:56.830853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:56.836784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.837256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.837680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.838348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.838790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.839200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.916475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:56.917458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:56.923498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.924007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.924456 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.925139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:56.925584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:56.926006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:56.975643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:56.983324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5289ad10-653e-413c-8040-76e3a5f928f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.157221 Sep 15 14:10:56.983928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 114/211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:56 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:57.067241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:57.087036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:57.088530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:57.089671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-790d6cb7-95bd-42d4-b5b9-e63c532dcf30 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.177063 Sep 15 14:10:57.090228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 98/212] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:56 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:57.393217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:57.393724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:57.399673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:57.400260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:57.400688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:57.401362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:57.401809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:57.402227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:57.508004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:57.508666 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:57.514442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:57.515511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:57.515975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:57.516663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:57.517111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:57.517644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:57.537013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:57.544527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b0adab11-5429-41f7-8fc1-8a9715a77e94 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.155739 Sep 15 14:10:57.545096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 115/213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:57 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:57.649828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:57.657816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5a311dbc-9ba1-427c-bafa-5562a24e3cf4 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.153739 Sep 15 14:10:57.658394 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 99/214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:57 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:58.006065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:58.006700 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:58.013441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.013951 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.014388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.015664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.016108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.016563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.116975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:58.117690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:58.125943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.125943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.125943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.129838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.130408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.130879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.175622 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.184546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e835e06-9f33-4e19-8da6-ce0d8ca09c9d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.181736 Sep 15 14:10:58.185312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 116/215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:58 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:58.272025 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.279933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.282008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.283099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ab1bae40-f9cd-480a-9e1c-90a8d9960449 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.170380 Sep 15 14:10:58.283652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 100/216] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:58 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:10:58.568180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:58.568780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:58.574864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.575343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.575801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.576484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.576931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.577970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.682293 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:58.683159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:58.689831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.690647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.690773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.691422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:58.691925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:58.692836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:58.713444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.722091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e515b2c4-c09a-4204-a752-83d3a793dcbe tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.157641 Sep 15 14:10:58.722658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 117/217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:58 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:58.824617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:58.833237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b4b217a8-28dd-4d6b-ac1e-d28db2e0f40b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.154731 Sep 15 14:10:58.833856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 101/218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:58 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:10:59.207616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:59.208242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:59.214104 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.214575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.215033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.215816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.216286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.216704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.308164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:59.308765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:59.315395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.316056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.316676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.317994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.317994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.318553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.358066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:59.366690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-15b3465b-78b3-4af7-a08e-8c8bf5a9b9b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.162849 Sep 15 14:10:59.367272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 118/219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:59 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:10:59.458599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:59.466632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:59.468760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:59.469851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-86694e91-c2f0-4f39-9820-f98c7b1cba05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.165808 Sep 15 14:10:59.470410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 102/220] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:10:59 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:10:59.745362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:59.746077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:59.752545 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.753095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.753589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.754829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.755490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.756046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.855859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:10:59.856477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:10:59.863825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.864305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.864732 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.865418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:10:59.865860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:10:59.866305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:10:59.893092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:10:59.904053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d86bfb03-27ee-4b32-b12d-fc309213f5f0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.162424 Sep 15 14:10:59.904668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 119/221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:59 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:00.157936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:00.166134 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c35f33b8-49e1-4918-b8b9-90a01e24cada tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.314075 Sep 15 14:11:00.166827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 103/222] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:10:59 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:00.391866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:00.392488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:00.401553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.402041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.402466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:00.403154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.403601 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.404051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:00.494222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:00.494837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:00.501853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.502374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.502810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:00.503560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.505078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.505544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:00.538212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:00.546930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-adb1e400-7a2a-4947-8daf-e1cc78dadca4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.158767 Sep 15 14:11:00.547789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 120/223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:00 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:00.636189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:00.649099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:00.650789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:00.652028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2b1b51dc-a2cf-4ce9-8a34-eb46f1d0804d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.161512 Sep 15 14:11:00.653011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 104/224] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:00 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:11:00.929436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:00.930134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:00.936217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.936953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.937377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:00.938053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:00.938496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:00.938907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.073285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.081588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-239427f8-abd4-4d93-b5f3-5cf2ae38e922 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.156221 Sep 15 14:11:01.082159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 121/225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:00 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:01.189464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:01.190054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:01.197374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.198254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.199031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.201655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.202985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.203838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.339561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.348519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-08ebf27b-d311-4955-a0b2-00fdbd69cf34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.162941 Sep 15 14:11:01.349096 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 105/226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:01 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:01.570448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:01.571051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:01.579045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.579523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.579975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.580710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.581142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.581553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.678720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:01.679858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:01.687398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.688123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.689283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.690097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:01.690529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:01.691637 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:01.709882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.722332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e73a0b13-7cf5-4937-9ee4-a5fe5b062716 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.155417 Sep 15 14:11:01.723487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 122/227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:01 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:01.825127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.833592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.835050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:01.836175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bce2241b-1cb4-4e64-9a77-4d293ad64912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.162577 Sep 15 14:11:01.836742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 106/228] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:01 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:11:02.104336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:02.104861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:02.110869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.111341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.111803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.112475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.112914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.113321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.117218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:02.242274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:02.250437 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0aab3d1d-651f-4f8f-a031-cb0176652f36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.150023 Sep 15 14:11:02.250999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 123/229] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:02 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:02.371104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:02.372312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:02.379164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.379747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.380268 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.380999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.381537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.382000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.515439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:02.523215 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0b8ef700-d9c6-4d8b-a802-0704b7dd756a tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.155998 Sep 15 14:11:02.523795 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 107/230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:02 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:02.746267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:02.746871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:02.753937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.754391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.755077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.755975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.756427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.757065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.862078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:02.862755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:02.869352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.870079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.870508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.871369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:02.871872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:02.872462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:02.914191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:02.922493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ac0592b7-60a4-4613-b100-91da14196172 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.180010 Sep 15 14:11:02.923729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 124/231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:02 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:03.026346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:03.034531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:03.035999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:03.037102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0db4a930-47d0-49ec-847e-8142311abe05 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.179205 Sep 15 14:11:03.037659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 108/232] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:02 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:03.272252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:03.272858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:03.278799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.279271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.279715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:03.280499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.280946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.281362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:03.421934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:03.429777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-66b00515-c853-48b4-a890-424b9888b117 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1362 microversion: 2.1 time: 0.161058 Sep 15 14:11:03.430388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 125/233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:03 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:03.546948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:03.547563 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:03.554736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.554736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.554736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:03.557348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.557828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.558768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:03.720816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:03.728850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0b9e1092-7ca5-4699-b2b0-e419a6c23dab tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.186477 Sep 15 14:11:03.729423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 109/234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:03 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:03.945574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:03.946188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:03.953340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.953830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.954259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:03.954946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:03.955398 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:03.955854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.063886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:04.064529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:04.071114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.071989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.072610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.073327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.073944 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.074372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.106994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.116363 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-98e7b809-29ac-466d-b7ca-77f49dc93c96 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.174444 Sep 15 14:11:04.117568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 126/235] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:03 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:04.229417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.237979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.239532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.240748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-00365d51-7dc7-40d1-bec4-92c1ec0813af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.180926 Sep 15 14:11:04.241302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 110/236] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:04 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:04.455343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:04.456216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:04.474514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.475013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.475462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.476233 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.476687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.477109 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.633018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.641346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9d187fe9-1c47-4d3a-94f0-6d8695a876b2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1549 microversion: 2.1 time: 0.191005 Sep 15 14:11:04.643880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 127/237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:04 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:04.664882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:04.665486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:04.672047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.672788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.673447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.674381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.674986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.675677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.752871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:04.754307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:04.755821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:04.762570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.763055 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.763635 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.764889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.766099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.766533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.826735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-90ac906a-1c44-4a67-af88-8558dd338dd0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165659 Sep 15 14:11:04.827987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 111/238] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:11:04 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:04.839375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bb208e-87b2-4a1d-aadd-6c494d83d01f", "name": "network-vif-plugged", "status": "completed", "tag": "37409932-0575-4016-bb98-a4f28388af35"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:04.855613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:04.856611 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:04.857036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:04.892559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] Creating event network-vif-plugged:37409932-0575-4016-bb98-a4f28388af35 for instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f on hv-cinder-85697 Sep 15 14:11:04.903869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-4e88c881-bd41-426f-b03b-9d709abdad85 req-e25e1b99-310e-43f3-abfe-cee076da5a41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074763 Sep 15 14:11:04.905054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 112/239] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:04.917140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:04.930649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-826023d8-d599-4318-90a5-aad4bb76e6f0 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.182100 Sep 15 14:11:04.931556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 128/240] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:04 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:05.139670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:05.140930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:05.146176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:05.148598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.149522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.150077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:05.150632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.151075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.151571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:05.265849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:05.266493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:05.272438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.272917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.273346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:05.274035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.274483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.274902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:05.415983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:05.425181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:05.426620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:05.430969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-907ff6ce-daf6-41c2-bcbe-4dd3e1a66bcd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.169055 Sep 15 14:11:05.432073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 129/241] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:05 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:11:05.623469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:05.639191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-672a1e3c-0ff8-4a5a-ace0-db20ecd2ebbc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.503228 Sep 15 14:11:05.651710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 113/242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:05 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:05.956501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:05.957717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:05.965081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.965908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.966656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:05.968099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:05.968720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:05.969486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.205134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:06.221870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-30bdb520-e341-45a4-9459-83558916022c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.268900 Sep 15 14:11:06.223820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 130/243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:05 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:06.458962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:06.458962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:06.465073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:06.465747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:06.466327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.467027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:06.467522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:06.468779 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.665734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:06.671936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:06.680254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:06.682816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:06.685075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.686303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:06.687151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:06.688627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.786246 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:06.805462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:06.810306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:06.812459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2199b092-bd55-463a-b075-d46bf7d41aa1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.357926 Sep 15 14:11:06.813419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 114/244] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:06 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:06.819389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7417b73e-2234-4215-95ab-040a71f66d6b", "tag": "e3f7891c-8d65-4cff-b08d-3a752660d65a"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:06.830534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:06.831538 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:06.832073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:06.848261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] Creating event network-changed:e3f7891c-8d65-4cff-b08d-3a752660d65a for instance 7417b73e-2234-4215-95ab-040a71f66d6b on hv-cinder-85697 Sep 15 14:11:06.855203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-c9ba83ef-97c1-4e0b-9437-3ae901b561e6 req-124d898d-820d-4135-8a00-09f4d98ff032 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040293 Sep 15 14:11:06.856349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 115/245] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:06.910259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:06.918906 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-891bd5e5-e223-49b0-8645-147bcaf4b99e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.258264 Sep 15 14:11:06.919935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 131/246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:06 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:07.252006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:07.253019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:07.263455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.264278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.264956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:07.266768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.267230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.268451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:07.587882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:07.605969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-85ab1842-dedb-4a91-8929-cdcba98d8833 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1314 microversion: 2.1 time: 0.362715 Sep 15 14:11:07.607117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 116/247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:07 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:07.842711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:07.843746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:07.849887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.850365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.850784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:07.851472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.851941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.852516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:07.946026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:07.947405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:07.955357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.956138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.956802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:07.957710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:07.959294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:07.966151 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:08.049037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:08.070280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:08.072210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:08.074106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-456db766-3c2c-4690-a832-f5aad043789c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.235357 Sep 15 14:11:08.074909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 132/248] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:07 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:08.187475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:08.196504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-14137960-15a7-4aa0-a65f-1f0a922c183c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.255422 Sep 15 14:11:08.197063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 117/249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:07 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:08.632670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:08.633563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:08.639832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:08.640825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:08.641423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:08.642274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:08.642868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:08.643571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:08.816343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:08.825987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de7aa2ca-e30f-4ba0-933b-f0dc38ceddbf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1501 microversion: 2.1 time: 0.196702 Sep 15 14:11:08.826833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 133/250] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:08 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:09.104219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:09.105532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:09.113455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:09.113943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:09.114509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:09.116319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:09.116803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:09.117245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:09.221215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:09.222767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:09.229801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:09.230371 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:09.230801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:09.231517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:09.232325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:09.234021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:09.298069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:09.310180 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:09.311807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:09.313165 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ca5f42f8-ae58-41e1-8a26-f4bc6051e831 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.215027 Sep 15 14:11:09.313805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 118/251] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:09 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:09.436126 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:09.446287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9cd9c558-951d-4874-b735-f22f77052d68 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.228997 Sep 15 14:11:09.464290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 134/252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:09 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:10.338731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:10.339333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:10.346309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:10.346785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:10.347214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:10.347923 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:10.348372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:10.348794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:10.471510 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:10.472151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:10.478133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:10.478613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:10.479230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:10.479950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:10.480765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:10.481238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:10.482893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:10.492534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:10.494578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:10.496049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-27bbb77d-343c-4226-be07-709007cb88e2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.161031 Sep 15 14:11:10.496949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 119/253] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:10 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:10.613720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:10.621790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-191d1f97-31fb-4293-9511-ee06e658c002 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1322 microversion: 2.1 time: 0.155113 Sep 15 14:11:10.622365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 135/254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:10 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:11.313782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be21bc3-b1a0-4556-a1f3-4f4abf0ed2c2"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:11.317070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:11.325625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.326395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.329010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.330242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.330693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.331365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.395546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "name": "network-vif-plugged", "status": "completed", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:11.426295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.426781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.429574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.475933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] Creating event network-vif-plugged:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:11:11.495107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-692a36e6-8248-4a20-8f90-d98197d64577 req-b76c83fb-fb2e-45e0-8b03-062463e71fd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103559 Sep 15 14:11:11.496435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 136/255] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:11.526885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:11.527665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:11.534326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.534920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.535563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.536346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.536875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.537376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.669304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:11.678135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:11.679577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:11.680699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-54e49a87-dd50-4b32-906b-12decb2ba5f3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.159240 Sep 15 14:11:11.681252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 137/256] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:11 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:11.699296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:11.699944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:11.706288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.706772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.707202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.707912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.708364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.708780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.844552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:11.852652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-af68da60-da0d-4d82-8b27-64d75e17b6f5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1516 microversion: 2.1 time: 0.170215 Sep 15 14:11:11.853245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 138/257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:11 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:11.876344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:11.878628 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:11.886942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.887428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.887893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.888585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:11.890348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:11.890749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:11.953660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'flavor' on Instance uuid 93bb208e-87b2-4a1d-aadd-6c494d83d01f {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:11:12.023869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:12.078017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-20de03f2-1b9d-4877-903f-204a31331f7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f/action" status: 200 len: 32 microversion: 2.1 time: 0.205777 Sep 15 14:11:12.078946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 139/258] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:11:11 2022] POST /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 14:11:12.088338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:12.089075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:12.095848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:12.096403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:12.096852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:12.097555 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:12.098009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:12.098436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:12.231619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:12.239974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-16b45a0d-c46b-4440-b026-9e0f208fccc4 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.155699 Sep 15 14:11:12.240543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 140/259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:12 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:12.706049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:12.706673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:12.708655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:12.713722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:12.714202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:12.714631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:12.715311 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:12.715786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:12.716202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:12.845386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:12.853427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:12.854855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:12.856012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-abc19999-b990-4d4d-adce-fe39ef28ac00 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.154370 Sep 15 14:11:12.856578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 141/260] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:12 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:11:13.172807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d068bf58-69c9-40b7-b07d-359927b43d42 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "POST /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.863127 Sep 15 14:11:13.175733 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 120/261] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:11:11 2022] POST /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5/os-volume_attachments => generated 194 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:13.262584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:13.263211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:13.270064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:13.270557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:13.270996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:13.271706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:13.272173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:13.272597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:13.413429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:13.422237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-177f7145-9cfe-42b4-89f1-0d9f267bdb79 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.163416 Sep 15 14:11:13.422948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 142/262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:13 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:13.881901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:13.882747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:13.889237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:13.889722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:13.890155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:13.890842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:13.891296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:13.891741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:14.021418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:14.029676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:14.031157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:14.032291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a9ab46b3-5001-4b06-a1d0-d976b80de1ea tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.155200 Sep 15 14:11:14.032855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 121/263] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:13 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:14.446148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:14.446861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:14.453566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:14.454053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:14.454573 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:14.455172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:14.455636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:14.456845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:14.592239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:14.601245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-954a8d53-2ca3-408b-89d1-a055b53fd92d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.158877 Sep 15 14:11:14.601814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 143/264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:14 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:15.059498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:15.060912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:15.072321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:15.073096 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:15.073816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:15.076600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:15.078000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:15.078705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:15.225119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:15.234732 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:15.236201 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:15.237287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3c579c9a-94b5-4ce5-a5d7-715d192c4bb6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1406 microversion: 2.20 time: 0.183749 Sep 15 14:11:15.237871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 122/265] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:15 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:15.624147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:15.624841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:15.630781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:15.631258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:15.631703 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:15.632390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:15.632839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:15.633261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:15.806931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:15.814827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1e4ed912-b373-4c9e-b41f-cf93bbb91182 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.194600 Sep 15 14:11:15.815395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 144/266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:15 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:16.262819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:16.263950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:16.271869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.272358 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.272790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:16.273487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.273939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.274363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:16.425152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:16.434734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:16.436469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:16.438277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a914a22e-f050-4e99-8d34-31d3a51efc57 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1597 microversion: 2.20 time: 0.179678 Sep 15 14:11:16.438826 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 123/267] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:11:16 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:11:16.466080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:16.466594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:16.475324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.476021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.476465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:16.477235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.477689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.478258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:16.569189 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-abbdd4da-05fc-4859-909d-f9face67a0e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107383 Sep 15 14:11:16.569961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 145/268] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 15 14:11:16 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:11:16.838027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:16.838800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:16.845325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.845903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.846413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:16.847186 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:16.847767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:16.848193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:17.307614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:17.316247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0342a5a0-bd66-4147-925a-b410c5431d7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.482039 Sep 15 14:11:17.317064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 124/269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:16 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:18.095525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:18.109511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:18.110200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:18.110774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:18.124699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] Creating event network-changed:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:11:18.132202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-e84d4d57-d183-4fe7-a7fd-8fe405b80a00 req-3bb86767-d821-482c-91f2-cb9106c4c709 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042118 Sep 15 14:11:18.132796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 146/270] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:18.338539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:18.339167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:18.345537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:18.346022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:18.346456 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:18.347150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:18.347601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:18.348069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:18.581496 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:18.593395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a7e3bf47-cb23-412b-9183-c2362953bfaf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.257935 Sep 15 14:11:18.604694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 125/271] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:18 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:19.618594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:19.619431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:19.626099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:19.626579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:19.627008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:19.627706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:19.628175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:19.628602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:19.761561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:19.769539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2f83227f-e826-4e75-878e-30c4d32e7a7c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.155206 Sep 15 14:11:19.770115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 147/272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:19 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:20.792100 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:20.792792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:20.799570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:20.800076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:20.800500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:20.801350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:20.801967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:20.802385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:20.963790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:20.968447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2ab9f3b7-8053-4a6f-b2a7-da3a182bd7d5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.178123 Sep 15 14:11:20.968447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 126/273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:20 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:21.989866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:21.991056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:21.997023 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:21.997574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:21.997948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:21.998635 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:21.999423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:21.999935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:22.161618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:22.169923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-af15045d-947d-4d6f-9913-f29bb0ece3bf tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.183720 Sep 15 14:11:22.170636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 148/274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:21 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:23.195252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:23.195978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:23.202591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:23.203227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:23.203713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:23.204691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:23.205218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:23.205718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:23.375898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:23.384403 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e529f3fc-d22a-410c-9641-5b4293229a5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.194490 Sep 15 14:11:23.384981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 127/275] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:23 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:24.418016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:24.419221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:24.427469 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:24.428927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:24.430160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:24.431286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:24.432105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:24.432930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:24.604681 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:24.622436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-86be9a21-ccde-4803-a89c-1a88caeb9404 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.211494 Sep 15 14:11:24.623486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 149/276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:24 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:25.645454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:25.646640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:25.653434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:25.653919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:25.654355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:25.655042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:25.655492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:25.655945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:25.675026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:25.813977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:25.821531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8a2482cc-bba6-46bd-af7b-1426b47d7a5c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.179854 Sep 15 14:11:25.822097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 128/277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:25 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:26.845320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:26.845960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:26.852175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:26.852661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:26.853091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:26.853810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:26.854258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:26.854675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:26.989832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:26.997337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b1fd4679-3df4-4814-a42d-8c5511c1cbf2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.156731 Sep 15 14:11:26.997909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 150/278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:26 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:28.019812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:28.020426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:28.026783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:28.027265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:28.027728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:28.028445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:28.028897 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:28.029318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:28.158199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:28.166108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-32425cbb-5adf-45da-89bc-3807210537cc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.150219 Sep 15 14:11:28.166765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 129/279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:28 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:29.189849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:29.190464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:29.196541 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:29.197019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:29.197448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:29.198129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:29.198573 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:29.198988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:29.326297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:29.334549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b3506f79-6eab-44fb-995a-95c5c929559c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.149188 Sep 15 14:11:29.335119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 151/280] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:29 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:30.357407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:30.358014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:30.364372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:30.364851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:30.365282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:30.365965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:30.366416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:30.366840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:30.494291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:30.502485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-950ea6c0-5eb3-4b39-a96f-894297f21efe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.148900 Sep 15 14:11:30.503049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 130/281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:30 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:31.525214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:31.525823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:31.532548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:31.533029 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:31.533462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:31.534145 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:31.534599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:31.535022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:31.664193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:31.671764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e1aff587-5058-4744-b620-8a3aa96cf246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.150444 Sep 15 14:11:31.672946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 152/282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:31 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:32.695004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:32.695604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:32.701940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:32.702421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:32.702853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:32.703731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:32.704308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:32.704737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:32.838500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:32.846768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0eef81f2-ce4b-4416-89d5-20135e1e1c84 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.155584 Sep 15 14:11:32.847343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 131/283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:32 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:33.290605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-856502610", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "networks": [{"uuid": "9201f9c5-6717-484a-984e-26d753a0213e"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:33.350497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] validate_networks() for [('9201f9c5-6717-484a-984e-26d753a0213e', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:11:33.582404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:33.583244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:33.590826 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.591312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.591762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.592455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.593606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.594207 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.621107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:11:33.714485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-49dd6656-13df-4cc2-ad8a-51007e3cc9a8 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 204 len: 0 microversion: 2.1 time: 0.136955 Sep 15 14:11:33.715869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 132/284] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:11:33 2022] DELETE /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 14:11:33.724450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:33.725139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:33.728566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:11:33.728986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:11:33.729446 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:11:33.729846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:11:33.730288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:11:33.731257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.731775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.732210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.732893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.733341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.733754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.738924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.739396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.739891 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.740607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.741058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.741475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.759106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Getting quotas for project 1e90b31934484572bf7c7bdcbc0fdf2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:11:33.763143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Getting quotas for user 0ad0877d583d4550b9ab14ee7f4394f0 and project 1e90b31934484572bf7c7bdcbc0fdf2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:11:33.775154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:11:33.777473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:11:33.824907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e2ebb787-b176-4d5e-aa26-af3b4387837a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537990 Sep 15 14:11:33.825558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 153/285] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:11:33.837534 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-872d75da-66de-4fd6-b326-841e737d3844 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:33.838164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-872d75da-66de-4fd6-b326-841e737d3844 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:33.903158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-872d75da-66de-4fd6-b326-841e737d3844 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:33.924195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-872d75da-66de-4fd6-b326-841e737d3844 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1218 microversion: 2.1 time: 0.090415 Sep 15 14:11:33.938741 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 154/286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:33 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:33.946468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:33.947410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:33.955965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.956732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.957646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:33.958785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:33.959315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:33.959845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:34.096337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:34.105952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8d28733d-33da-4853-bc62-764fa70b01c5 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1553 microversion: 2.1 time: 0.385418 Sep 15 14:11:34.106593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 133/287] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:33 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:34.129217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:34.136978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1d9ea442-980f-487f-ae9a-e2ce0ebe2c4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.194981 Sep 15 14:11:34.137962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 155/288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:33 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:34.946242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:34.946835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:34.953356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:34.953841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:34.954278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:34.954968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:34.955419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:34.955877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:35.017760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:35.025347 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ee489045-a432-4077-923a-960664f7b4a8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1222 microversion: 2.1 time: 0.082884 Sep 15 14:11:35.026025 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 134/289] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:34 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:35.128124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:35.128735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:35.143707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:35.144601 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:35.145757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:35.146543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:35.147151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:35.147582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:35.164997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:35.165605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:35.180515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:35.183080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:35.184318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:35.184984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:35.186292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:35.187511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:35.188503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:35.315982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:35.324867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-015ac858-0d83-4c52-bf37-127cef566632 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1553 microversion: 2.1 time: 0.200571 Sep 15 14:11:35.325932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 156/290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:35 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:35.350548 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:35.358961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ad2cb8c9-f816-4163-ba22-07f6c68a8982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.197709 Sep 15 14:11:35.360401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 135/291] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:35 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:36.050649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:36.051289 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:36.057211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.057687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.058142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.059094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.059540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.059977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.124646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:36.131973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:36.136561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ab949d11-4f40-48b9-bced-0de84dc85622 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1270 microversion: 2.1 time: 0.090728 Sep 15 14:11:36.140824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 157/292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:36 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:36.349121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:36.349981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:36.356635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.357127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.357566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.358350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.358724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.359428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.389349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:36.390037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:36.402432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.402930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.403365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.404366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:36.405039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:36.405676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:36.588751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:36.599115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-df796302-4821-446b-bffb-96025244b35d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.214450 Sep 15 14:11:36.599998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 158/293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:36 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:36.634394 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:36.642990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a95ff104-d3bd-45d7-8128-9e4196f5494b tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1553 microversion: 2.1 time: 0.297748 Sep 15 14:11:36.643562 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 136/294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:36 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:37.160998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:37.161884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:37.168812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.169340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.169940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.170747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.171203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.172822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.236260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:37.246590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-91077230-80ef-431c-acfe-95df49960a84 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1276 microversion: 2.1 time: 0.090175 Sep 15 14:11:37.249830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 159/295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:37 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:37.622814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:37.623505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:37.636763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.637553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.637896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.638588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.639035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.639457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.667712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:37.668370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:37.677086 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.677753 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.679059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.680902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:37.681373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:37.681803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:37.848338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:37.861934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fb4661d5-ecfc-4c97-9b87-5531e179ba86 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1553 microversion: 2.1 time: 0.198303 Sep 15 14:11:37.863238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 160/296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:37 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:37.890330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:37.898724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b35a858f-793f-41b7-b3e6-2bdfee9230f1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.279807 Sep 15 14:11:37.899300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 137/297] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:37 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:38.272880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:38.273496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:38.279600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.280131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.280563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.281480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.282310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.282738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.320146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce73090-a133-4df0-a89a-3fab142222e4", "tag": "a92e59df-5df6-40c5-83f5-9920814a1b5a"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:38.349031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.349519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.350202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.376863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] Creating event network-changed:a92e59df-5df6-40c5-83f5-9920814a1b5a for instance 3ce73090-a133-4df0-a89a-3fab142222e4 on hv-cinder-85697 Sep 15 14:11:38.382544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-c81a511e-acb3-4d22-a155-126c2750ebb2 req-b4d19218-016b-4413-abeb-9c156a21a753 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091884 Sep 15 14:11:38.383466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 138/298] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:11:38.532898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:38.540503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3470b6ac-0d8d-4230-a62e-463ca32956c3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.271361 Sep 15 14:11:38.541075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 161/299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:38 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:38.888326 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:38.890182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:38.912988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.914209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.916099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.917754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.918350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.918998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.929169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:38.930361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:38.943438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.944202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.944852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:38.945722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:38.946334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:38.947642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:39.121774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:39.131122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d3805d18-4814-4412-b8e1-dbb86afa9288 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.212556 Sep 15 14:11:39.132086 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 162/300] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:38 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:39.297819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:39.309743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a1780fef-57df-4a20-a793-dd499d464fae tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1553 microversion: 2.1 time: 0.427385 Sep 15 14:11:39.311429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 139/301] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:38 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:39.563536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:39.565123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:39.573571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:39.575039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:39.575519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:39.576256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:39.576702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:39.577118 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:39.963237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:39.973017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6325dc16-5072-41c2-ab8e-9f113474a1b2 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.414450 Sep 15 14:11:39.973918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 163/302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:39 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:40.155022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:40.155627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:40.162536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:40.163018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:40.163459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:40.164224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:40.164629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:40.165366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:40.298769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:40.313519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5d0c2add-81cf-451d-b149-6d4de3d5bafe tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.162196 Sep 15 14:11:40.314110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 140/303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:40 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:40.334692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:40.335566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:40.342494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:40.343052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:40.344015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:40.345440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:40.346270 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:40.346632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:40.398295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd08b47f-85ba-4a0c-9450-9ec3005732d5", "name": "network-vif-deleted", "tag": "96de7222-ae08-4df9-8d02-8bde6a53ae43"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:40.408485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:40.408962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:40.409386 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:40.420243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] Creating event network-vif-deleted:96de7222-ae08-4df9-8d02-8bde6a53ae43 for instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 on hv-cinder-85697 Sep 15 14:11:40.425709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:40.426163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-32a7f00f-118d-405c-b12b-d2b60b53cccf req-4ce726a3-0664-4a14-8b60-747ebdd73b36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Sep 15 14:11:40.426763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 141/304] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:11:40.435889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7ead5224-d424-4d4e-ba93-baba52c87f94 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.107080 Sep 15 14:11:40.436547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 164/305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:40 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:40.998845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:40.999939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:41.009738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.009738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.009738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.009738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.010056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.011559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.156747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:41.178312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fe8b98bb-a407-4b5b-8bc1-6d69a2828429 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.184229 Sep 15 14:11:41.187827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 142/306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:40 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:41.337753 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:41.337753 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:41.346207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.347402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.348188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.350561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.351175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.351665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.460667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:41.461276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:41.468830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.469526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.470130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.470835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:41.471293 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:41.471740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:41.500484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:41.508495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d17a8b51-b0cf-44ca-871d-46204bae9246 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.176030 Sep 15 14:11:41.523627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 165/307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:41 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:41.541042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:41.549877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-31bb9fe5-6e74-4fe0-9e45-f91e36f7da38 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.094621 Sep 15 14:11:41.550448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 143/308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:41 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:42.201779 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:42.202395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:42.208879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.209388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.209819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.210502 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.210956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.211377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.338511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:42.346668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d04ab003-9b07-4d88-944e-547ce6c9f7bf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.148723 Sep 15 14:11:42.347228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 166/309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:42 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:42.531614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:42.532371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:42.538608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.539081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.539510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.540208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.540655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.541068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.573893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:42.574518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:42.581883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.582377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.582806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.583515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:42.583998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:42.584422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:42.649168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:42.658229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-edd29660-5db6-4c31-9cf3-ef040162c4bf tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.088167 Sep 15 14:11:42.658828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 167/310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:42 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:42.802221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:42.806112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:42.812665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-67453771-e69f-4be9-89a7-79882351d9be tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.284540 Sep 15 14:11:42.812665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 144/311] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:42 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:43.370667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:43.371337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:43.373218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:43.378936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.379416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.379880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.380592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.381033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.381447 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.524638 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:43.535828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d04d782f-c32a-422e-acfd-7f3700fa7c9b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.168930 Sep 15 14:11:43.536397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 168/312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:43 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:43.681818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:43.682354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:43.690350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.690842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.691282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.692003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.692460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.692885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.753559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:43.761547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5c35c74d-7b3b-4fd2-a9b0-64da9fb6f106 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.084395 Sep 15 14:11:43.762114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 145/313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:43 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:43.834501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:43.835102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:43.836956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:43.842211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.842686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.843110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.843909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:43.844361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:43.844788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:43.917403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=8 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:43.972138 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:43.979621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7eab7e15-0d1f-47f7-8468-25397c9f5898 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.148936 Sep 15 14:11:43.980196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 169/314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:43 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:44.558678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:44.559656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:44.565728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:44.566291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:44.566801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:44.567585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:44.568143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:44.568631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:44.785316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:44.785861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:44.792021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:44.792506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:44.792940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:44.793630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:44.794082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:44.794504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:44.857063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:44.865334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cc114041-f7b0-4b3b-bd30-e712345fe99c tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.084624 Sep 15 14:11:44.865902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 170/315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:44 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:44.889204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:44.897597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c1e02116-6e0c-4ca6-ad42-3d91ecdcdd9a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.342827 Sep 15 14:11:44.898161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 146/316] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:44 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:45.002477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:45.003092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:45.009037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.009513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.009939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.010616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.011066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.011480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.143081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:45.150875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f242bf2-67e9-41c2-b963-682d131553b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.152849 Sep 15 14:11:45.151444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 171/317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:44 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:45.888650 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:45.889165 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:45.895589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.896183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.896514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.897196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.897644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.898060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.920450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:45.921047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:45.927943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.928424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.928933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.929542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:45.929994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:45.930522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:45.960600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:45.969737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-894344ac-d542-41af-bfd3-79d994edff89 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1511 microversion: 2.1 time: 0.085223 Sep 15 14:11:45.970307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 147/318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:45 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:46.060141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:46.067785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eef4ce5a-8320-4faa-9256-e917420b1c7b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.151310 Sep 15 14:11:46.068345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 172/319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:45 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:46.173324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:46.173853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:46.179745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:46.180238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:46.180671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:46.181356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:46.181809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:46.182228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:46.310893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:46.319097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-67d5b8cf-2ecf-4bb5-b23d-6fc2ee4d5be8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.149631 Sep 15 14:11:46.319664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 148/320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:46 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:46.993065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:46.993683 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:47.004806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.005752 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.006183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.006932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.007390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.007840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.077413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:47.086306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-301c40e9-7dbf-4e2b-8621-223ed2cd78a3 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1345 microversion: 2.1 time: 0.097034 Sep 15 14:11:47.087064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 173/321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:46 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:47.096018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:47.097187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:47.102912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.103398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.103879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.104617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.105074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.105494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.320168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:47.327589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4c796cb7-c0bf-4fca-9f18-c149bdbd1835 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.241064 Sep 15 14:11:47.328399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 149/322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:47 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:47.342200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:47.342914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:47.349717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.350329 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.350821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.351626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:47.352247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:47.352729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:47.372083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:47.483780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:47.491995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f417a4f-8df7-418a-a5b2-bb4762e3e9f0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.153627 Sep 15 14:11:47.492634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 174/323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:47 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:48.108805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:48.111635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:48.118150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.118641 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.119081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.119909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.120364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.120787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.159484 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.160024 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.160467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.160916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lazy-loading 'fault' on Instance uuid dd08b47f-85ba-4a0c-9450-9ec3005732d5 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:11:48.210010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f521b038310940d1b5ee7fc5afc1cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd903de84a9c7446e9a2f368e5eab8719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:48.218305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-14d529d1-7f2b-451c-a05f-263ce64afc34 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 200 len: 1350 microversion: 2.1 time: 0.113239 Sep 15 14:11:48.218914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 150/324] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:48 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:48.349547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce73090-a133-4df0-a89a-3fab142222e4", "name": "network-vif-plugged", "status": "completed", "tag": "a92e59df-5df6-40c5-83f5-9920814a1b5a"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:11:48.356141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:48.356944 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:48.368167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.368709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.369133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.369836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.371728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.372148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.380521 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.381001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.381426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.393134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] Creating event network-vif-plugged:a92e59df-5df6-40c5-83f5-9920814a1b5a for instance 3ce73090-a133-4df0-a89a-3fab142222e4 on hv-cinder-85697 Sep 15 14:11:48.402561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-b48e7b55-692f-4ae8-a6d6-bb23032824eb req-7a63456f-ef45-4ddc-9da0-fe47fb948355 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056460 Sep 15 14:11:48.403463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 175/325] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:11:48.515374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:48.516259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:48.521225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:48.523099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.523588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.524054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.524747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:48.525205 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:48.525627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:48.529673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4cdac76c-964d-4b10-a15a-ebd9e5ba767c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.177710 Sep 15 14:11:48.539717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 151/326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:48 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:48.684649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:48.692749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2972009c-871a-46da-96d5-8fe4d6cc4772 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.181707 Sep 15 14:11:48.693298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 176/327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:48 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:49.241850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:49.242452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:49.248675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.249155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.249655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.250351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.250793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.251211 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.264724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] HTTP exception thrown: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Request method failure captured: Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 HTTP/1.1 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIwTwgImaew7VrSl-IFdt946BudhUyXupR9VuebgH78SHrVyWvXbnYVkULOMKKI_D2WV3CphUWw_F-8fdK-0vzkcww5ljGZczDb1y5d9Zx-mC3CGCvQkJh0woFbWULOpXg-NQRhksH2x77g1iG54-BUZIKfE4lDDxmS-E9yF73uCCs Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:11:49.270622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}] Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: f521b038310940d1b5ee7fc5afc1cbac Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.272262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'dd08b47f-85ba-4a0c-9450-9ec3005732d5'} Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:11:49.272998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.274334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.275446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Returning 404 to user: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:11:49.275446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bc25ec90-5b2a-49ef-b680-706f5f1d6943 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 404 len: 111 microversion: 2.1 time: 0.034211 Sep 15 14:11:49.276255 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 152/328] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:49 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:11:49.398664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:49.401201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:49.409129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.409750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.410211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.411012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.411519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.411965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.426381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] HTTP exception thrown: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Request method failure captured: Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5/os-volume_attachments HTTP/1.1 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIwTwgImaew7VrSl-IFdt946BudhUyXupR9VuebgH78SHrVyWvXbnYVkULOMKKI_D2WV3CphUWw_F-8fdK-0vzkcww5ljGZczDb1y5d9Zx-mC3CGCvQkJh0woFbWULOpXg-NQRhksH2x77g1iG54-BUZIKfE4lDDxmS-E9yF73uCCs Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:11:49.430512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}] Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: f521b038310940d1b5ee7fc5afc1cbac Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.431713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'server_id': 'dd08b47f-85ba-4a0c-9450-9ec3005732d5'} Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:11:49.432427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:49.433588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:49.435012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Returning 404 to user: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:11:49.435012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d15c7e0c-dbb7-4b1e-8a06-b239892772f9 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038222 Sep 15 14:11:49.435012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 177/329] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:11:49 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:11:49.554319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:49.554949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:49.563621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.564694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.565459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.566040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.566496 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.567784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.716984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:49.718085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:49.720892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:49.725429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.726008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.726526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.727347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:49.727905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:49.728403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:49.729331 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fa421f7c-647c-477f-a715-530caa6c1024 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.179436 Sep 15 14:11:49.729910 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 153/330] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:49 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:49.859711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:49.867269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-11978f24-226e-487d-b679-dd64b646aff0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.154771 Sep 15 14:11:49.867861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 178/331] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:49 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:50.752336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:50.752973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:50.759299 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:50.759810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:50.760245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:50.760918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:50.761367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:50.761785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:50.889611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:50.890068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:50.890964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:50.896999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:50.897503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:50.897934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:50.898189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-07bb7dd0-d133-45ed-971c-257d7c990296 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.149902 Sep 15 14:11:50.898620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:50.898876 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 154/332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:50 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:50.899143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:50.899627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:51.026363 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:51.033950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6f322ac0-3f46-4461-9d29-4d9765d5623e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.148222 Sep 15 14:11:51.034512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 179/333] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:50 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:51.920185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:51.920813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:51.928012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:51.928489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:51.928917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:51.929599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:51.930049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:51.930477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:52.056496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:52.057147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:52.057682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:52.063740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:52.064229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:52.064671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:52.065372 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:52.065490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-73b494a4-ea85-4efa-a990-a270e4954df8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.149068 Sep 15 14:11:52.065954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:52.066080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 155/334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:51 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:52.066383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:52.193930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:52.201533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-354155d8-fe83-4178-bd3c-619cdbafdf6d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.149051 Sep 15 14:11:52.202098 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 180/335] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:52 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:53.088741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:53.089259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:53.096235 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.096708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.097139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.097818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.098266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.098683 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.224864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:53.225474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:53.231370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.231886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.232177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:53.232323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.232991 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.233435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.233859 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.241010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ce8d4b03-ffd0-412b-b582-851d76a6dd1d tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.156142 Sep 15 14:11:53.241656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 156/336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:53 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:53.360333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:53.367937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-27e4fd7f-d6f1-4944-8ad1-92e4b8eae7f9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.147023 Sep 15 14:11:53.368505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 181/337] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:53 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:53.818771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:53.819260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:53.825682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.826161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.826590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.827271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.828498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.829117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.845217 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] HTTP exception thrown: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Request method failure captured: Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: DELETE /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 HTTP/1.1 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIwTwgImaew7VrSl-IFdt946BudhUyXupR9VuebgH78SHrVyWvXbnYVkULOMKKI_D2WV3CphUWw_F-8fdK-0vzkcww5ljGZczDb1y5d9Zx-mC3CGCvQkJh0woFbWULOpXg-NQRhksH2x77g1iG54-BUZIKfE4lDDxmS-E9yF73uCCs Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:11:53.846772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}] Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: f521b038310940d1b5ee7fc5afc1cbac Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.848169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'dd08b47f-85ba-4a0c-9450-9ec3005732d5'} Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:11:53.848828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.850163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.851272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Returning 404 to user: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:11:53.851272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8747d81d-b113-4c1a-8b1f-fa1da5685037 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 404 len: 111 microversion: 2.1 time: 0.033351 Sep 15 14:11:53.851272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 157/338] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:11:53 2022] DELETE /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:11:53.857256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:53.857861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] [instance: dd08b47f-85ba-4a0c-9450-9ec3005732d5] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:53.864543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.865019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.865441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.866121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:53.866564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:53.866977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:53.889221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] HTTP exception thrown: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Request method failure captured: Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 HTTP/1.1 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIwTwgImaew7VrSl-IFdt946BudhUyXupR9VuebgH78SHrVyWvXbnYVkULOMKKI_D2WV3CphUWw_F-8fdK-0vzkcww5ljGZczDb1y5d9Zx-mC3CGCvQkJh0woFbWULOpXg-NQRhksH2x77g1iG54-BUZIKfE4lDDxmS-E9yF73uCCs Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:11:53.892508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d903de84a9c7446e9a2f368e5eab8719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d903de84a9c7446e9a2f368e5eab8719"}]}] Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d903de84a9c7446e9a2f368e5eab8719 Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-DeleteServersTestJSON-755804065 Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: f521b038310940d1b5ee7fc5afc1cbac Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-DeleteServersTestJSON-755804065-project Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.893898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'dd08b47f-85ba-4a0c-9450-9ec3005732d5'} Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:11:53.894769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. Sep 15 14:11:53.896454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:11:53.898530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] Returning 404 to user: Instance dd08b47f-85ba-4a0c-9450-9ec3005732d5 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:11:53.898530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e598a5b-aa3d-4884-a2a6-4f5eaba27212 tempest-DeleteServersTestJSON-755804065 tempest-DeleteServersTestJSON-755804065-project] 10.222.0.27 "GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5" status: 404 len: 111 microversion: 2.1 time: 0.040541 Sep 15 14:11:53.898530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 182/339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:53 2022] GET /compute/v2.1/servers/dd08b47f-85ba-4a0c-9450-9ec3005732d5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:11:54.264387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:54.265002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:54.272355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:54.272846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:54.273289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:54.273995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:54.274449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:54.274879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:54.391490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:54.392229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:54.398524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:54.399012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:54.399451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:54.400175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:54.400631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:54.401054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:54.537016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:54.545473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7f5c6521-36c3-459d-881c-b9afb8c9c982 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.158360 Sep 15 14:11:54.546072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 183/340] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:54 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:54.549985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:54.558099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-32f5b38c-8dbb-4671-bded-b14d671b5e8c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.298176 Sep 15 14:11:54.558754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 158/341] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:54 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:55.569103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:55.569707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:55.575643 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:55.576146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:55.576770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:55.577252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:55.578464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:55.579181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:55.582402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:55.583021 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:55.589360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:55.589847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:55.590289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:55.590982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:55.591608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:55.592065 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:55.723425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:55.732301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-03314c0c-1fcf-4ef4-ba68-7fc23e29928d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.166949 Sep 15 14:11:55.740535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 184/342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:55 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:55.828756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:55.836546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-587cab9a-d944-41e6-bf23-3e447dd90923 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.258648 Sep 15 14:11:55.842423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 159/343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:55 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:56.756289 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:56.757065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:56.763572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:56.764720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:56.765215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:56.765917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:56.766365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:56.766783 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:56.867219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:56.867991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:56.878314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:56.879083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:56.879766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:56.880693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:56.881447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:56.882196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:56.940494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:56.948229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-07e596e8-2ccf-4439-b606-e2bc4bef6b12 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.195784 Sep 15 14:11:56.948818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 185/344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:56 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:57.136252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:57.150089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f0190ca3-8558-4a95-afd4-d330c09a4473 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.294025 Sep 15 14:11:57.164745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 160/345] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:56 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:57.972387 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:57.973275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:57.985611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:57.986166 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:57.986609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:57.991142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:57.991614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:57.992069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:58.174688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:58.176195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:58.183567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:58.184494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:58.185062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:58.185780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:58.186243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:58.186671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:58.335922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:58.342249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:58.344114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6ef06168-4b5e-470f-8ece-bd06fbf02ebd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.376509 Sep 15 14:11:58.344777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 186/346] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:57 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:58.350295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a707e40e-ee59-4b5c-bf58-7a6cca4363c7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1318 microversion: 2.1 time: 0.179764 Sep 15 14:11:58.351116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 161/347] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:58 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:11:59.368137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:59.373921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:11:59.375132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:59.375659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:11:59.390022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:59.390701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:59.391142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:59.391865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:59.392320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:59.392737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:59.397458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:59.397955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:59.398382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:59.399263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:11:59.399912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:11:59.400339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:11:59.419493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:11:59.547023 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:59.548096 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:11:59.555732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1df191b3-06e9-4822-aa99-8c4e91ae7095 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.191546 Sep 15 14:11:59.556588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 187/348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:59 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:11:59.563845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-74074f06-de47-4744-884f-b050e94ea488 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1507 microversion: 2.1 time: 0.194198 Sep 15 14:11:59.564578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 162/349] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:11:59 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:00.579980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:00.580794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:00.587058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:00.587649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:00.588179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:00.589176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:00.589654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:00.590174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:00.739965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:00.748432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-262ef32d-b662-49d2-9380-08c461ba3d42 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.173844 Sep 15 14:12:00.749001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 188/350] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:00 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:01.771705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:01.772319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:01.778645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:01.779128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:01.779570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:01.780281 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:01.780899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:01.781410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:01.915058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:01.923253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c98d7b5e-e44e-4a6e-b8b6-28f550e588d0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.155431 Sep 15 14:12:01.923873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 163/351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:01 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:02.949562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:02.950259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:02.957341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:02.957955 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:02.958395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:02.959361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:02.959537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:02.959983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:03.097631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:03.106297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-82558a84-a577-4d1d-a331-13c6475c6e01 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.163863 Sep 15 14:12:03.119842 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 189/352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:02 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:04.130982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:04.131638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:04.138198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:04.138716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:04.139158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:04.139897 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:04.140356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:04.140830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:04.281340 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:04.291992 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-63a50093-2eed-4e35-a5b4-ad5ba60c765f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.166006 Sep 15 14:12:04.292744 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 164/353] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:04 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:05.317726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:05.318429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:05.324736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:05.325218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:05.325648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:05.326338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:05.326794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:05.327214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:05.477554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:05.486945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d0c7fc59-b410-4d05-a7a1-4911532423fb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.173868 Sep 15 14:12:05.487528 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 190/354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:05 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:06.510230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:06.510850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:06.514154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=62 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:06.518988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:06.519472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:06.520003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:06.520694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:06.521145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:06.521561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:06.659472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:06.667500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-68d18d33-b7c7-4943-90a8-35b77432c4ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.161054 Sep 15 14:12:06.668110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 165/355] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:06 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:07.691415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:07.692074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:07.700789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:07.701662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:07.702449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:07.704494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:07.705256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:07.705790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:07.845549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:07.853673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4010a904-e5ac-4cd7-b0d2-c5cbe486363f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.166244 Sep 15 14:12:07.854257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 191/356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:07 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:08.877830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:08.878338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:08.884704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:08.885182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:08.885610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:08.886285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:08.886730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:08.887148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:09.021398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:09.029191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0de6d08b-b3ec-41a8-8362-cb8f3fff6a23 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.156664 Sep 15 14:12:09.029755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 166/357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:08 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:10.052123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:10.052731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:10.058620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:10.059096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:10.059819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:10.060503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:10.060952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:10.061381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:10.190089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:10.197660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b8b9d490-6fae-4e2b-8dff-7aeec0f906dd tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.149441 Sep 15 14:12:10.198217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 192/358] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:10 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:11.221342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:11.221958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:11.228742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:11.229230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:11.229693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:11.230391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:11.230847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:11.231274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:11.380682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:11.388955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cc34154b-c658-410b-a6ce-e49761eb8513 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.171883 Sep 15 14:12:11.389534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 167/359] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:11 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:12.414199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:12.414805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:12.420690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:12.421174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:12.421603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:12.422288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:12.422770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:12.423285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:12.427415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:12.556768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:12.567946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-df68d54b-8fb3-4f92-bdc2-10f2b5043e2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.157476 Sep 15 14:12:12.568538 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 193/360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:12 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:13.591837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:13.592448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:13.598921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:13.599405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:13.599871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:13.600565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:13.601121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:13.601437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:13.735271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:13.742873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2b01e150-db92-44fc-9cb5-667a63a4a1e2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1522 microversion: 2.1 time: 0.154858 Sep 15 14:12:13.743431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 168/361] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:13 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:14.765264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:14.766000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:14.768081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=52 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:14.773263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:14.773747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:14.774178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:14.774867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:14.775317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:14.775827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:14.912868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:14.920841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8dd4a3df-3e0b-447b-84f8-21a1d03c8614 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1502 microversion: 2.1 time: 0.159217 Sep 15 14:12:14.921761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 194/362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:14 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:14.944727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:14.945339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:14.952027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:14.952580 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:14.952950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:14.953642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:14.954098 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:14.954521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:15.089331 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:15.098235 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8b55e38c-343b-41f2-b8e0-ecb4b7ed7a24 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1516 microversion: 2.1 time: 0.157230 Sep 15 14:12:15.098805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 169/363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:14 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:16.512493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:16.514771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:16.521173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:16.521660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:16.522090 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:16.522787 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:16.523238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:16.523653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:16.547732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'flavor' on Instance uuid e27d1fdf-b409-467e-9b03-2a2d60ca01f8 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:12:16.635565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-17836d04-0005-4eae-b999-e0b54e7a4504 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/action" status: 200 len: 32 microversion: 2.1 time: 0.126901 Sep 15 14:12:16.636463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 195/364] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:12:16 2022] POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:12:16.649180 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:16.650499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:16.660138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:16.660764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:16.661305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:16.662112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:16.662729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:16.663267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:16.899714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:16.907983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5511751f-645a-4b17-a509-b6fcaeb3d7ca tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.265323 Sep 15 14:12:16.909103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 170/365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:16 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:17.930895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:17.931598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:17.938191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:17.938690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:17.939121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:17.940382 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:17.940871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:17.941415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:18.074495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:18.082793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c399af91-b327-42fc-ba96-06c9b0040911 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.156135 Sep 15 14:12:18.083362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 196/366] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:17 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:19.106324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:19.107102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:19.117811 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:19.118325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:19.118967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:19.119521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:19.120007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:19.120455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:19.262177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:19.270035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-56944167-69c2-471c-90e0-e0178caa3e5e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.168149 Sep 15 14:12:19.270725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 171/367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:19 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:20.294030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:20.294632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:20.301107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:20.301585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:20.302009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:20.302692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:20.303137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:20.303554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:20.437092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:20.445407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-82c3acef-2b46-4d4b-8327-4e94cb68bcc2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.155104 Sep 15 14:12:20.445920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 197/368] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:20 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:21.467755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:21.468294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:21.475858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:21.476343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:21.476829 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:21.477512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:21.477956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:21.478371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:21.648955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:21.657329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bd586753-519a-4167-8981-cad4374d9c04 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.193416 Sep 15 14:12:21.657906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 172/369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:21 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:22.680435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:22.681287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:22.687551 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:22.688087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:22.688522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:22.689212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:22.689677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:22.690100 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:22.832281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:22.841031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-49cfdf63-3d6f-4ff6-a60c-adf8a46e2f8a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.164334 Sep 15 14:12:22.842692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 198/370] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:22 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:23.866185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:23.866801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:23.873105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:23.873590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:23.874028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:23.874720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:23.875177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:23.875610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:24.045130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:24.054859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-587abeda-89f7-472d-8406-6bddb932f83d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.192656 Sep 15 14:12:24.056018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 173/371] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:23 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:25.078653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:25.079021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:25.085017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:25.085500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:25.085936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:25.086626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:25.087111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:25.087534 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:25.214979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:25.223436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e28fc9f5-1e9a-4ee5-8e95-24fa53a1addc tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.149018 Sep 15 14:12:25.224034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 199/372] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:25 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:26.246010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:26.246613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:26.253006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:26.253490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:26.253922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:26.254607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:26.255054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:26.255471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:26.400894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:26.409574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f48e1e34-458f-4814-94fe-482297c4dc1f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.167295 Sep 15 14:12:26.410121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 174/373] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:26 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:27.432004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:27.432562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:27.438752 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:27.439224 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:27.439642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:27.440982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:27.441435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:27.441846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:27.575052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:27.583558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-64bac99e-cdec-4378-a143-bd6a3d0bbe4f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.155651 Sep 15 14:12:27.584395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 200/374] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:27 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:28.607671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:28.608305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:28.615158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:28.615644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:28.616219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:28.616916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:28.617366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:28.617781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:28.746820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:28.754238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bade1a61-6f68-4cd3-8dec-fabd34ef2c92 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.150306 Sep 15 14:12:28.754979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 175/375] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:28 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:29.777279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:29.777893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:29.784013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:29.784461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:29.784895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:29.785813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:29.786282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:29.786704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:29.913716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:29.921329 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aebe2b9a-f7e0-4df9-9a8f-fa058811adb8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.147913 Sep 15 14:12:29.921898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 201/376] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:29 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:30.943359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:30.943925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:30.950205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:30.950682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:30.951112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:30.951817 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:30.952267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:30.952685 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:30.955153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=81 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:31.079183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:31.087371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4fd2ce6c-3e64-44fe-9089-cccf70065f08 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.148148 Sep 15 14:12:31.087968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 176/377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:30 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:32.110592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:32.111112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:32.118037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:32.118509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:32.118930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:32.119599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:32.120075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:32.120487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:32.248742 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:32.256320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9f76fae7-5f67-4a5d-8d37-07dd8e8530b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.149719 Sep 15 14:12:32.256886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 202/378] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:32 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:33.279518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:33.280157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:33.286727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:33.287423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:33.287907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:33.288598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:33.289048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:33.289468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:33.421436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:33.429873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-27a73c23-214b-45fd-8429-6e61449e616e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.154242 Sep 15 14:12:33.430656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 177/379] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:33 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:34.454505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:34.455136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:34.461783 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:34.462284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:34.463027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:34.463746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:34.464357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:34.464774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:34.600711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:34.608466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-572d59b5-8775-418d-9397-2969131e543e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.157856 Sep 15 14:12:34.609040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 203/380] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:34 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:35.630204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:35.631455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:35.637899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:35.638390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:35.638824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:35.639549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:35.640097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:35.640519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:35.771784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:35.779714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-21d1361b-5e74-48da-9e6b-8fc0cb3dc32a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.153501 Sep 15 14:12:35.780291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 178/381] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:35 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:36.040270 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5517637a-7bb0-4e2a-b975-f8f0e23af8af", "device": "/dev/sdb"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:36.043359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:36.049256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:36.049738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:36.050163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:36.050843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:36.051286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:36.051720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:36.805110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:36.806207 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:36.808587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=28 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:36.819287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:36.822315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:36.823155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:36.824127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:36.824647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:36.825369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:36.947764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-92a0cb8b-5020-4a3c-bda5-163e45bb5caf tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "POST /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911654 Sep 15 14:12:36.949562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 204/382] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:12:36 2022] POST /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:12:36.987620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:37.000118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-39728223-d779-41c4-bfa2-9ae3de25e850 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1502 microversion: 2.1 time: 0.200331 Sep 15 14:12:37.000789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 179/383] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:36 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:37.038389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59622685-4b86-42aa-adc2-79e56609508f"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:37.038389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:37.038389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.038389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.039108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.039108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.039108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.039402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.066980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] HTTP exception thrown: Cannot 'attach_volume' instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 while it is in vm_state rescued Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Request method failure captured: Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/os-volume_attachments HTTP/1.1 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 74 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIzMGQvybpYHXpUl0WfjKIaM7DDV6NGuHx57yeWD7RgT527KG2NTita9SIHh18fKz1r5xLTtE5dfZCoCRICUszao2ziKZfU13K9oyt4WPOQW9e0xw4-G42Isz-ipC6_d3srTZT84lwujN_2QTqZT4HsejBHWO_pLAdDI4DAZqrl2fc Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:12:37.070006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fab43b244e854c0296530db48bc1b975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fab43b244e854c0296530db48bc1b975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}] Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 530e6587b39b4f4c98d7414b81453628 Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {"volumeAttachment": {"volumeId": "59622685-4b86-42aa-adc2-79e56609508f"}} Sep 15 14:12:37.071757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Cannot 'attach_volume' instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 while it is in vm_state rescued Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'server_id': 'e27d1fdf-b409-467e-9b03-2a2d60ca01f8', 'body': {'volumeAttachment': {'volumeId': '59622685-4b86-42aa-adc2-79e56609508f'}}} Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:12:37.072831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 while it is in vm_state rescued Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:12:37.074560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 while it is in vm_state rescued Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Returning 409 to user: Cannot 'attach_volume' instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 while it is in vm_state rescued {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6264a30-2927-4f1b-b906-b11a23c6e317 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049861 Sep 15 14:12:37.076033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 205/384] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:12:37 2022] POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 14:12:37.080985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:37.081736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:37.087737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.088238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.088675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.089376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.089834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.090264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.164105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d9a4e9ce-862f-4bd8-ad20-b549fa03e2ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/action" status: 202 len: 0 microversion: 2.1 time: 0.086583 Sep 15 14:12:37.165525 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 180/385] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:12:37 2022] POST /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:12:37.176526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:37.179466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:37.188514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.188998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.189427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.190115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:37.190726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:37.191410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:37.352396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:37.356500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:37.361459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5b4059b8-d0fc-455f-96d6-343e288e88ae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1510 microversion: 2.1 time: 0.191028 Sep 15 14:12:37.362599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 206/386] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:37 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:38.389418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:38.389418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:38.393260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:38.393743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:38.394204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:38.394915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:38.395366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:38.395814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:38.534046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:38.542775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a7a7c120-552f-48df-a47f-543d2f353ad1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1510 microversion: 2.1 time: 0.161057 Sep 15 14:12:38.543381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 181/387] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:38 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:39.565935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:39.566529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:39.575015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:39.575496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:39.575993 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:39.576693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:39.577139 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:39.577554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:39.741712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:39.752759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-364a4bb1-2bec-45cb-a925-7bcb96b7c1b8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1510 microversion: 2.1 time: 0.190840 Sep 15 14:12:39.753583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 207/388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:39 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:40.776363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:40.776879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:40.783206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:40.783707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:40.784159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:40.784848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:40.785305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:40.785734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:40.918846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:40.926553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b75d2a92-5121-460d-ab6a-a2cee8caee0a tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1516 microversion: 2.1 time: 0.154181 Sep 15 14:12:40.927119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 182/389] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:40 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:41.391488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-633793129", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "networks": [{"uuid": "7ab97aa9-0dd2-4077-90b1-e96c2e7eb1fa"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:41.446537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] validate_networks() for [('7ab97aa9-0dd2-4077-90b1-e96c2e7eb1fa', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:12:41.814209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:12:41.814695 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:12:41.815232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:12:41.815721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:12:41.816201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:12:41.826461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:41.827050 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:41.827519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:41.828271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:41.828806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:41.829237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:41.847232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Getting quotas for project 6c7cce87cd0c4e6785bd0db3abe77f27. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:12:41.853391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Getting quotas for user 649ca2e37c934e4cb50e59bb4765b6b7 and project 6c7cce87cd0c4e6785bd0db3abe77f27. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:12:41.864724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:12:41.867973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:12:41.914099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-42761c01-fe07-4911-9ad0-c7273c7ab285 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526284 Sep 15 14:12:41.914934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 208/390] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:12:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:12:41.926815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c33c91a4-48bd-4bd6-b4a9-97a4ae8c2e05 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:41.928106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c33c91a4-48bd-4bd6-b4a9-97a4ae8c2e05 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:41.982164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c33c91a4-48bd-4bd6-b4a9-97a4ae8c2e05 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:41.997046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c33c91a4-48bd-4bd6-b4a9-97a4ae8c2e05 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1213 microversion: 2.1 time: 0.074633 Sep 15 14:12:41.997813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 183/391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:41 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:43.021076 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:43.021681 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:43.027785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:43.028263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:43.028687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:43.029359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:43.029800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:43.030210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:43.091944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:43.099599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c88cd3f2-c841-4044-b5eb-4c95e8b99c8b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1265 microversion: 2.1 time: 0.082857 Sep 15 14:12:43.100188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 209/392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:43 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:43.362898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fef04c87-e651-41f4-abd6-484b36692783 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: .version_select at 0x7fab479f83a0>, body: {"keypair": {"name": "tempest-keypair-519547951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI70nvuUhYH7vLCyhVAmCJ5/+JV1bkjXInVl3H07dwbXVr11QYe34uW8bM7YiTuCaQcL4yCJM9TLNVLwiAtMBzIjjaZuJ907kEjhG9yMJ/VmoRaYCwG4sRI6l/fBituwrQ=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:43.379567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-fef04c87-e651-41f4-abd6-484b36692783 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for project fab43b244e854c0296530db48bc1b975. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:12:43.384058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-fef04c87-e651-41f4-abd6-484b36692783 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for user 530e6587b39b4f4c98d7414b81453628 and project fab43b244e854c0296530db48bc1b975. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:12:43.417904 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fef04c87-e651-41f4-abd6-484b36692783 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059225 Sep 15 14:12:43.418622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 184/393] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:12:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:12:44.122315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:44.123084 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:44.129518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:44.130001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:44.131044 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:44.131922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:44.132578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:44.133039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:44.218800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:44.229702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cedfbf90-9a16-4601-b7e8-851c88dae09a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1265 microversion: 2.1 time: 0.110922 Sep 15 14:12:44.230905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 210/394] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:44 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:44.797310 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-849580123", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bf6b9d0-61d2-43ca-8735-1d5e3544a1e6"}], "security_groups": [{"name": "tempest-securitygroup--1703448388"}], "key_name": "tempest-keypair-519547951", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:44.966154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] validate_networks() for [('4bf6b9d0-61d2-43ca-8735-1d5e3544a1e6', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:12:45.258269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:45.258985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:45.261531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:45.267288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:45.267998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:45.268511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:45.269303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:45.269986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:45.270491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:45.342493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:45.350663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c589dad3-022a-46b7-8c72-0b266d47c6d8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1271 microversion: 2.1 time: 0.096902 Sep 15 14:12:45.351562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 211/395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:45 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:45.617993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:12:45.618522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:12:45.619106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:12:45.619640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:12:45.620359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:12:45.629456 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:45.630116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:45.631409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:45.632452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:45.633001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:45.633984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:45.656189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:12:45.661226 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Getting quotas for user 530e6587b39b4f4c98d7414b81453628 and project fab43b244e854c0296530db48bc1b975. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:12:45.674374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:12:45.676780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:12:45.729538 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d55e7ba8-1113-4233-b1be-0d3a23b2ae05 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.936403 Sep 15 14:12:45.730284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 185/396] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:12:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:12:45.742661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-63599c6e-3ca5-42d9-9fa6-0ac43f3dcebb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:45.743618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-63599c6e-3ca5-42d9-9fa6-0ac43f3dcebb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:45.804996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-63599c6e-3ca5-42d9-9fa6-0ac43f3dcebb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:45.814336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-63599c6e-3ca5-42d9-9fa6-0ac43f3dcebb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1244 microversion: 2.1 time: 0.076154 Sep 15 14:12:45.814978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 212/397] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:45 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:46.374754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:46.375364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:46.381566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:46.382048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:46.382481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:46.383170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:46.383624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:46.384081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:46.691958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:46.700543 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bc439b98-0a56-402e-b912-a28010ea1ee3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.330108 Sep 15 14:12:46.701263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 186/398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:46 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:46.839515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:46.840167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:46.846923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:46.847438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:46.847977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:46.848572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:46.849176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:46.850206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:46.917866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:46.926790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80807bef-5fb3-4e38-bd5c-9c66d8b41a46 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.091153 Sep 15 14:12:46.927614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 213/399] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:46 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:46.967408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e0bc0c-26d2-4261-b6e6-0cc587848266", "tag": "d9cfd7de-2c78-4b58-bfa2-a56295ddc544"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:46.977847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:46.978713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:46.979393 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:46.991157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] Creating event network-changed:d9cfd7de-2c78-4b58-bfa2-a56295ddc544 for instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 on hv-cinder-85697 Sep 15 14:12:46.995973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-9d94d881-0439-45aa-aea7-702d473b82cc req-373c9acf-f08e-4151-8fab-3c03b8cdf8fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032413 Sep 15 14:12:46.996586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 187/400] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:12:47.727523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:47.728154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:47.734108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:47.734674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:47.735159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:47.736006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:47.736456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:47.736904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:47.872334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:47.879970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4a79bf9f-7093-42e7-9172-27b51a2c49c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.156797 Sep 15 14:12:47.880718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 214/401] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:47 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:47.953278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:47.953971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:47.960517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:47.960998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:47.961427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:47.962121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:47.962565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:47.963122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:48.031372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:48.039886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ea02434f-ebb6-4900-b826-52660c4db995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.091610 Sep 15 14:12:48.040446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 188/402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:47 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:48.902809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:48.903444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:48.909776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:48.910243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:48.910663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:48.911331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:48.911953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:48.912507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:49.043594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:49.051285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-12959baa-1537-48d1-9f29-27ef58161ce5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.152449 Sep 15 14:12:49.051874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 215/403] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:48 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:49.062368 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:49.063068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:49.070097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:49.070681 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:49.071129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:49.071848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:49.072311 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:49.072735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:49.133492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:49.140957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-245eba95-6a8d-42a6-88e3-0551a3f8ea52 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.082650 Sep 15 14:12:49.141519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 189/404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:49 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:50.074269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:50.074872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:50.081392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:50.081871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:50.082300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:50.082978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:50.083452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:50.083956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:50.162882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:50.163483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:50.169883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:50.170377 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:50.170808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:50.171501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:50.171980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:50.172408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:50.217257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:50.225627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80f04d75-c76b-4352-9030-c9e20e30b4bd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.155243 Sep 15 14:12:50.226194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 216/405] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:50 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:50.234300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:50.241970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f300999b-af67-4c35-b1bb-81ec55ada796 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.083432 Sep 15 14:12:50.242606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 190/406] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:50 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:51.248489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:51.249059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:51.255476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:51.255994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:51.256427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:51.257141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:51.257596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:51.258036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:51.264341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:51.264948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:51.271845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:51.272420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:51.272856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:51.273556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:51.274012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:51.274431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:51.340328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:51.348150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f4eb4c11-e63e-461a-9c13-9ebaeb07b959 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.087499 Sep 15 14:12:51.348722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 191/407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:51 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:51.395284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:51.403870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9a8fa975-9865-46bf-95d3-207720c85167 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.159305 Sep 15 14:12:51.404524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 217/408] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:51 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:52.371757 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:52.372357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:52.378866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:52.379444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:52.379832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:52.380576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:52.381136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:52.381607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:52.426890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:52.428134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:52.429990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:52.436314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:52.436802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:52.437235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:52.437967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:52.438427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:52.438844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:52.446064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:52.453577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b71aae12-4b3c-4068-bf76-e5f63c603c59 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.085633 Sep 15 14:12:52.454139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 192/409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:52 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:52.572508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:52.580599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2344e234-2aec-4d08-bb4e-f764f19d7732 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.157368 Sep 15 14:12:52.581188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 218/410] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:52 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:12:53.476294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:53.476921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:53.485913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:53.485913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:53.485913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:53.485913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:53.486420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:53.486420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:53.546896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:53.555261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7d058a4b-7eca-4915-a50c-37fdeebfeec7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.082940 Sep 15 14:12:53.555857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 193/411] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:53 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:53.603843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:53.604360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:53.610679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:53.611158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:53.611592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:53.612624 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:53.613075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:53.613494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:53.741324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:53.749040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c745b0fe-a3b7-4786-ab4c-a1f1e70e1520 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.149207 Sep 15 14:12:53.749615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 219/412] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:53 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:54.578360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:54.578968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:54.585367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:54.585854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:54.586289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:54.586971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:54.587423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:54.587875 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:54.647880 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:54.655220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f751d5f4-93cc-44ca-a1fc-f0fa1cf3b974 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1296 microversion: 2.1 time: 0.080763 Sep 15 14:12:54.655800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 194/413] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:54 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:54.773229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:54.773772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:54.780313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:54.780823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:54.781255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:54.781942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:54.782395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:54.782813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:54.908511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:54.917099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-60fd30ab-07a1-472e-bb7c-b584e65c136f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.148339 Sep 15 14:12:54.917669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 220/414] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:54 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:55.679076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:55.680604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:55.687456 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:55.688494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=12 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:55.691053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:55.691857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:55.692646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:55.694549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:55.695404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:55.696113 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:55.701946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:55.794247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:55.809947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bdfc3748-5424-44c5-9d3c-5b82406a0d3d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1302 microversion: 2.1 time: 0.135110 Sep 15 14:12:55.812949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 195/415] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:55 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:55.940562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:55.941498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:55.945492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=8 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:12:55.953214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:55.954046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:55.954676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:55.955496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:55.956152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:55.956648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:56.207355 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:56.221363 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb28e9e7-12cb-48f5-939b-680e79f8f49c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.284572 Sep 15 14:12:56.238506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 221/416] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:55 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:56.837889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:56.838497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:56.844943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:56.845430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:56.845868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:56.846565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:56.847020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:56.847444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:56.986584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:56.994953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b5c9b06d-7e81-407e-8d2f-219ab8602563 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.161401 Sep 15 14:12:56.995568 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 196/417] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:56 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:57.137707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:12:57.148240 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:57.149036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:57.149670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:57.160967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] Creating event network-changed:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:12:57.166292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-b2339ad3-14c4-4757-a90f-c114e1936527 req-2f8d54fb-919e-4b3a-b8c9-0a5ab3098d90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 Sep 15 14:12:57.166968 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 222/418] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:12:57.253070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:57.253670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:57.260488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:57.260965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:57.261389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:57.262069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:57.262517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:57.262936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:57.395573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:57.403248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-75fc401e-fac0-4848-8a1c-6c5fae039cbe tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.153951 Sep 15 14:12:57.403828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 197/419] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:57 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:58.019022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:58.019737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:58.026488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:58.026965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:58.027393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:58.028109 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:58.028558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:58.028974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:58.157874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:58.165498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8defb17b-8d6a-4547-aaa6-38dbc94b7c93 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.150782 Sep 15 14:12:58.166064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 223/420] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:58 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:58.425446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:58.426043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:58.432549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:58.433027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:58.433457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:58.434140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:58.434590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:58.435006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:58.567060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:58.575529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-48b8d78a-4ba4-42d4-b6af-8cc5866a0c48 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.153988 Sep 15 14:12:58.576330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 198/421] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:58 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:59.187522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:59.188151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:59.194853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:59.195325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:59.195777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:59.196453 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:59.196897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:59.197307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:59.323047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:59.330690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f81b974b-acd6-4fea-abde-0cf1322435c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.147343 Sep 15 14:12:59.331263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 224/422] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:59 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:12:59.597589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:12:59.598197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:12:59.604776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:59.605257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:59.605695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:59.606388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:12:59.606830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:12:59.607251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:12:59.734197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:12:59.742556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cce390b1-9c09-44af-b66c-d171016689dd tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.148717 Sep 15 14:12:59.743115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 199/423] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:12:59 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:00.354314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:00.354919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:00.361099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:00.361574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:00.362002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:00.362676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:00.363119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:00.363532 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:00.492210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:00.495718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:00.500627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a44eb326-4391-4a3c-8533-011214694cde tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.150644 Sep 15 14:13:00.501193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 225/424] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:00 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:00.765264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:00.765905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:00.772880 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:00.773368 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:00.773805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:00.774494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:00.774953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:00.775380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:00.904100 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:00.911655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d9c7653b-6343-478a-8a6e-0bc51aedae0f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150203 Sep 15 14:13:00.912954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 200/425] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:00 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:01.523772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:01.524291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:01.530872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:01.531348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:01.531804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:01.532491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:01.532939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:01.533358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:01.659754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:01.668132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5d04f983-9cfb-473c-b735-8601dda963b5 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.148433 Sep 15 14:13:01.668693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 226/426] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:01 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:01.934370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:01.934905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:01.941398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:01.941874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:01.942302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:01.942979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:01.944160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:01.944789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:02.073413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:02.080892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bfbc7528-a23e-4ae6-aec4-bdf20f538861 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150408 Sep 15 14:13:02.081454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 201/427] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:01 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:02.690365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:02.690980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:02.697385 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:02.697876 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:02.698305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:02.699000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:02.699457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:02.699908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:02.855349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:02.863419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-adc8ac00-8d16-48df-a45a-f719a0a13d3e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.176810 Sep 15 14:13:02.864025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 227/428] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:02 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:03.103636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:03.104194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:03.110533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:03.111018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:03.111457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:03.112181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:03.112644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:03.113093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:03.242794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:03.250321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-83213e46-ffec-4f0e-a708-f46ebcf43857 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150815 Sep 15 14:13:03.250888 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 202/429] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:03 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:03.887070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:03.887701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:03.894095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:03.894574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:03.895004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:03.895702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:03.896170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:03.896637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:04.026092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:04.033586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7c00363b-72ed-4844-95cd-4a4ec36b5f54 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.150485 Sep 15 14:13:04.034152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 228/430] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:03 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:04.273849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:04.274463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:04.280833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:04.281318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:04.281759 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:04.282444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:04.282899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:04.283322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:04.409905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:04.417514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dcd83bc0-a7c2-40ce-98c5-d29f33ca5af6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.147491 Sep 15 14:13:04.418069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 203/431] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:04 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:05.057129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:05.057735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:05.064362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:05.064870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:05.065300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:05.065972 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:05.066417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:05.066830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:05.193983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:05.202331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d411df46-ed37-4f31-a815-f41f88f92276 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.150064 Sep 15 14:13:05.202889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 229/432] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:05 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:05.440403 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:05.440925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:05.448082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:05.448566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:05.449002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:05.449691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:05.450146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:05.450571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:05.577815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:05.585813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ea31a7ca-d542-4626-ba54-26e5b65df7d2 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.149131 Sep 15 14:13:05.586376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 204/433] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:05 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:06.225345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:06.225983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:06.232227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:06.232705 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:06.233134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:06.233832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:06.234267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:06.234686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:06.361630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:06.370154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bc359708-c02c-46fb-9b32-e9b55bbfb21c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.148672 Sep 15 14:13:06.370724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 230/434] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:06 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:06.609008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:06.609606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:06.616051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:06.617174 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:06.617604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:06.618278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:06.618724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:06.619140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:06.748073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:06.755609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cefb788a-ab32-4a0e-9fc9-aac69df50066 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150419 Sep 15 14:13:06.756192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 205/435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:06 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:07.393568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:07.394197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:07.400726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:07.401201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:07.401629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:07.402310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:07.402755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:07.403167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:07.529345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:07.536970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-18e9aed0-2c35-442c-99dc-297e2239ea06 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.147301 Sep 15 14:13:07.537535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 231/436] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:07 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:07.778834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:07.779445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:07.781778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:07.787933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:07.789027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:07.789655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:07.790352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:07.790811 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:07.791238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:07.918196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:07.925845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a8311ba2-5977-4713-b6c3-1b5595cce84d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150862 Sep 15 14:13:07.926424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 206/437] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:07 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:08.560839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:08.561447 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:08.567844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:08.568267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:08.568694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:08.569963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:08.570626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:08.571045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:08.701486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:08.709007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7d580fac-45b9-4582-9d77-d93ebeffb818 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.152307 Sep 15 14:13:08.709571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 232/438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:08 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:08.949738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:08.950255 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:08.956585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:08.957067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:08.957504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:08.958187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:08.958689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:08.959113 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:09.091247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:09.098837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3f41cb80-1db3-40ca-a4b8-a27c5ad6562f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.153164 Sep 15 14:13:09.099396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 207/439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:08 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:09.732626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:09.733237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:09.739607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:09.740135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:09.740646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:09.741451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:09.741899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:09.742315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:09.868033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:09.875708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8aadd548-94fa-4e1b-9909-28f46180faad tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.146893 Sep 15 14:13:09.876291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 233/440] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:09 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:10.121267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:10.121938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:10.128257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:10.128733 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:10.129167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:10.129855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:10.130483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:10.130909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:10.263285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:10.270809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bc14d1e5-a320-43ff-aa4d-9aaad06c9f06 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.153483 Sep 15 14:13:10.271372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 208/441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:10 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:10.898871 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:10.899475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:10.905836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:10.906310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:10.906737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:10.907418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:10.907902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:10.908317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:11.043343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:11.051000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aca842f8-f177-424c-9b86-f1e601d16a76 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.156497 Sep 15 14:13:11.051574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 234/442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:10 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:11.293332 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:11.294182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:11.300649 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:11.301139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:11.301578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:11.302300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:11.302753 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:11.303181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:11.445261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:11.453082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dc8e559e-192f-43c6-a07f-e41ce145a5fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.163589 Sep 15 14:13:11.453661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 209/443] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:11 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:12.074621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:12.075253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:12.081712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:12.082190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:12.082620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:12.083323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:12.083799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:12.084214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:12.218135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:12.226561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-64a6c21b-9aa8-4562-9734-891f08c338de tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.155066 Sep 15 14:13:12.227137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 235/444] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:12 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:12.477722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:12.478337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:12.484518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:12.485058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:12.485428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:12.486119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:12.486565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:12.486985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:12.615860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:12.623974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-95377f1b-dce8-4e7c-ba2e-a6c1aa15b0ea tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.150464 Sep 15 14:13:12.624535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 210/445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:12 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:13.111025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e0bc0c-26d2-4261-b6e6-0cc587848266", "name": "network-vif-plugged", "status": "completed", "tag": "d9cfd7de-2c78-4b58-bfa2-a56295ddc544"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:13.123913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:13.124507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:13.124939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:13.136571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] Creating event network-vif-plugged:d9cfd7de-2c78-4b58-bfa2-a56295ddc544 for instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 on hv-cinder-85697 Sep 15 14:13:13.141576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-cf32d246-0d83-456d-bb99-0a632e58bc85 req-b3d45f86-6ee2-4ba4-95ce-9b1f0fba1c5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 Sep 15 14:13:13.142165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 236/446] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:13.249060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:13.249668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:13.255527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:13.256051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:13.256514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:13.258084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:13.258540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:13.258968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:13.396032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:13.398922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:13.405332 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dbb9442d-8708-421b-a7fc-8ec8ea82dc82 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.160145 Sep 15 14:13:13.405893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 211/447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:13 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:13.647592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:13.648244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:13.654359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:13.654843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:13.655277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:13.655995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:13.656449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:13.656869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:13.785114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:13.793133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5d6caecb-b953-400a-b4dc-fc80b7dfad7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.149840 Sep 15 14:13:13.793707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 237/448] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:13 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:14.415437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:14.416158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:14.423937 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.424427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.424858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.425551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.426005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.426429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.427711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:14.428362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:14.449508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.450002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.450439 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.451142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.451594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.452043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.553991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lazy-loading 'services' on Instance uuid 3ce73090-a133-4df0-a89a-3fab142222e4 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:13:14.587138 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:14.594864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e680b63e-9034-418b-acbc-03fb5eb57ed7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.171347 Sep 15 14:13:14.595430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 238/449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:14 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:14.668014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-26bc552f-13f7-4b22-9733-00bc47a93ee5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4/os-volume_attachments/5517637a-7bb0-4e2a-b975-f8f0e23af8af" status: 202 len: 0 microversion: 2.1 time: 0.256907 Sep 15 14:13:14.668619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 212/450] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:13:14 2022] DELETE /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4/os-volume_attachments/5517637a-7bb0-4e2a-b975-f8f0e23af8af => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:13:14.817565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:14.818180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:14.824705 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.825185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.825618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.826306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:14.826761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:14.827179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:14.953073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:14.961463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-92a7a40a-1370-42b3-a122-cc4d5d548c37 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.147768 Sep 15 14:13:14.962022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 239/451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:14 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:15.619101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:15.619730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:15.626751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:15.627209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:15.627640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:15.628357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:15.628804 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:15.629218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:15.760108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:15.767533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-03e47652-b61c-444e-9ad1-3c051cd64e9c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.152835 Sep 15 14:13:15.768125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 213/452] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:15 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:15.984581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:15.985184 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:15.987590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=60 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:15.993492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:15.993966 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:15.994391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:15.995066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:15.995541 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:15.995985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:16.128677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:16.137468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e2fcac16-a14c-4385-83bb-3c86c2340582 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.156682 Sep 15 14:13:16.138030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 240/453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:15 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:16.789791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:16.790475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:16.797419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:16.797909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:16.798345 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:16.799036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:16.799488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:16.799950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:16.946108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:16.956199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-400e8587-09e1-4a82-a8f6-4ebfabed2b77 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.169863 Sep 15 14:13:16.959562 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 214/454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:16 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:17.160851 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:17.161589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:17.168368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:17.168845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:17.169267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:17.170032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:17.170482 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:17.170894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:17.218265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:13:17.218560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 (ip 10.222.0.27) !!! Sep 15 14:13:17.301254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:17.309503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ed64420b-7b66-4a37-8d6c-0635c99fc76f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.152464 Sep 15 14:13:17.310078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 241/455] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:17 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:17.981981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:17.982579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:17.989041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:17.989517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:17.989949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:17.990624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:17.991814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:17.992250 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:18.127091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:18.135282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f6d8ce18-ec25-48e7-b0cf-5a2ccd1a058e tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.157376 Sep 15 14:13:18.135873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 215/456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:17 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:18.332955 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:18.333575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:18.340235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:18.340718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:18.341155 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:18.341845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:18.342299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:18.342721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:18.475094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:18.483209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2f4bc69d-0506-4fc2-9b8a-d08398631924 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1313 microversion: 2.1 time: 0.154101 Sep 15 14:13:18.483797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 242/457] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:18 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:18.978254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:18.978793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:18.985218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:18.985702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:18.985822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:18.986526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:18.986983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:18.987440 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.014385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:13:19.092663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e22881c1-4020-48ae-b050-ff24c55de807 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 204 len: 0 microversion: 2.1 time: 0.118177 Sep 15 14:13:19.093264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 216/458] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:13:18 2022] DELETE /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:13:19.102068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:19.102714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:19.109140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.109636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.110085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.110773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.111223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.111640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.117841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:19.156344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "name": "network-vif-plugged", "status": "completed", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:19.167327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.167907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.168451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.181089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] Creating event network-vif-plugged:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:13:19.186596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-7ee8f397-a046-4cbe-b027-ed7d00d146dd req-ecb6fa86-50b9-4451-b102-55c59de8de7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 Sep 15 14:13:19.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 217/459] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:13:19.192359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:19.193053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:19.199409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.199937 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.200451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.201547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.201938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.202369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.249736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:19.257810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-53404661-cdf8-4bbd-a880-766ac82ab7f7 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1513 microversion: 2.1 time: 0.160184 Sep 15 14:13:19.258381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 243/460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:19 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:19.333562 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:19.341715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dd9f12eb-4bbb-47ae-be47-e7d55f46c4f3 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.153327 Sep 15 14:13:19.342279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 218/461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:19 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:19.505529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:19.506148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:19.512780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.513261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.513831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.514570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:19.515033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:19.515453 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:19.648223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:19.656216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-45477acd-14d5-4c50-8316-11c968f867ee tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1497 microversion: 2.1 time: 0.154513 Sep 15 14:13:19.656786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 244/462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:19 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:20.262758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:20.263241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:20.269606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.270091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.270528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.271216 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.271675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.272121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.281633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:20.282251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:20.288145 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.288626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.289054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.289738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.290187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.291182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.298405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:13:20.378343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a4bcb140-89e3-4f74-b569-657c80c8b968 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 204 len: 0 microversion: 2.1 time: 0.119291 Sep 15 14:13:20.378930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 219/463] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:13:20 2022] DELETE /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:13:20.383846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:20.384558 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:20.390480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.390958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.391391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.392105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.392553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.392980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.423236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:20.431556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e51bb21b-77e0-4ba0-9846-9ded807fee96 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1513 microversion: 2.1 time: 0.153140 Sep 15 14:13:20.432256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 245/464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:20 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:20.436892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:20.437492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:20.443168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.443645 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.444132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.444818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:20.445264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:20.445680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:20.531796 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:20.539497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-69da4277-9b2d-44dd-a57c-920cea3499ec tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.159439 Sep 15 14:13:20.540128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 220/465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:20 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:20.593497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:20.601291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f959e4e3-fb99-476a-8752-cc570629eb7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1503 microversion: 2.1 time: 0.168100 Sep 15 14:13:20.601864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 246/466] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:20 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:21.455228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:21.455866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:21.462101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.462581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.463046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.465122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.465122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.465122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.563350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:21.564020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:21.570621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.571139 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.571646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.572428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.573099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.573550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.595416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:21.603025 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a67d3819-7fc7-4959-b1b1-efaa42436019 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1513 microversion: 2.1 time: 0.151573 Sep 15 14:13:21.604468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 221/467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:21 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:21.626006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:21.626609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:21.632769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.633465 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.633688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.634382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:21.635067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:21.635951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:21.720652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:21.730671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d2f7f232-0114-410e-8b24-a5461645bfd0 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.171311 Sep 15 14:13:21.743938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 247/468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:21 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:21.773133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:21.781616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7c778846-9526-4c74-8ed9-207cfe763b1f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1503 microversion: 2.1 time: 0.159502 Sep 15 14:13:21.782207 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 222/469] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:21 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:22.627961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:22.628569 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:22.635660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.636230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.636721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.637468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.637996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.638477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.753533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:22.754225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:22.761661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.762254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.762775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.763720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.764123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.764616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.782623 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:22.795087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ef741710-80d5-4778-894a-78a8b83d4b21 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1513 microversion: 2.1 time: 0.170887 Sep 15 14:13:22.795848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 248/470] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:22 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:22.814103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:22.816381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:22.831327 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.831866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.832290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.832981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:22.833427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:22.833838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:22.947105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:22.955915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-59e789ed-7fb5-4278-87e1-e8e6de8858cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.205946 Sep 15 14:13:22.957169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 223/471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:22 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:23.001853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:23.011988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-82e62f1a-ed56-432c-a3c6-db77e0612881 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1503 microversion: 2.1 time: 0.201852 Sep 15 14:13:23.013423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 249/472] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:22 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:23.542414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce73090-a133-4df0-a89a-3fab142222e4", "name": "network-vif-deleted", "tag": "a92e59df-5df6-40c5-83f5-9920814a1b5a"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:23.552331 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.552818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.553249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:23.565882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] Creating event network-vif-deleted:a92e59df-5df6-40c5-83f5-9920814a1b5a for instance 3ce73090-a133-4df0-a89a-3fab142222e4 on hv-cinder-85697 Sep 15 14:13:23.571098 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-5be93d9f-1eff-4877-87a5-994cd56c98fa req-dc141324-3581-4b7c-b337-4b7ae30cbb69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033039 Sep 15 14:13:23.571949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 224/473] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:23.818873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:23.819388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:23.826240 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.826719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.827232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:23.828019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.828485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.828915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:23.917894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:23.928178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-82c5827b-2604-4eed-8a39-7bcee7854c41 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1303 microversion: 2.1 time: 0.113166 Sep 15 14:13:23.930426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 250/474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:23 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:23.977372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e0bc0c-26d2-4261-b6e6-0cc587848266", "name": "network-vif-deleted", "tag": "d9cfd7de-2c78-4b58-bfa2-a56295ddc544"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:23.981323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:23.982023 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:23.988411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.988905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.989345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:23.989673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.990046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:23.990501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.990657 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:23.990923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:23.991475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:24.003635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] Creating event network-vif-deleted:d9cfd7de-2c78-4b58-bfa2-a56295ddc544 for instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 on hv-cinder-85697 Sep 15 14:13:24.010494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d8e9d898-654e-492d-b761-98992e8b2b54 req-b122a41b-5c1d-4807-87f5-ee3661a38575 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036893 Sep 15 14:13:24.011821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 225/475] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:24.040411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:24.041293 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:24.047281 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:24.047815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:24.048256 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:24.048960 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:24.049416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:24.049844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:24.065610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:24.115429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:24.124674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3e36b11a-82db-4157-8542-ef1c81a3744b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1461 microversion: 2.1 time: 0.088382 Sep 15 14:13:24.125492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 226/476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:24 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:24.214765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:24.224361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f679100e-bf62-4827-bc00-696ce07cc206 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1370 microversion: 2.1 time: 0.247828 Sep 15 14:13:24.224912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 251/477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:23 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:24.955187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:24.956837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:24.966545 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:24.967401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:24.968304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:24.969376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:24.970297 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:24.971418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.015560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.016198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.017398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.017398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lazy-loading 'fault' on Instance uuid 3ce73090-a133-4df0-a89a-3fab142222e4 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:13:25.066058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:25.074496 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-17ec584d-82f0-41d7-b46d-b5c4af0b3e40 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 200 len: 1308 microversion: 2.1 time: 0.124301 Sep 15 14:13:25.075074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 227/478] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:24 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:25.152133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:25.153740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:25.161938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.162489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.162925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.163632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.164130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.164553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.216215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.216699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.217125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.217565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lazy-loading 'fault' on Instance uuid 10e0bc0c-26d2-4261-b6e6-0cc587848266 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:13:25.250052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:25.250632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:25.258977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.260309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.260922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.261796 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.262697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.263129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.272965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:25.284629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1dd5de55-8fdb-40a9-b8b9-8e0cffb595c8 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1303 microversion: 2.1 time: 0.138929 Sep 15 14:13:25.288362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 252/479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:25 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:25.436451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:25.444644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1401080f-ff17-48e0-ac48-787787570229 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1565 microversion: 2.1 time: 0.200247 Sep 15 14:13:25.445223 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 228/480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:25 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:25.467263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:25.468085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:25.474521 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.475245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.475994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.476765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:25.477226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:25.477651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:25.629317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3ecb2e19-e85b-4536-be1b-a6ec43b1552d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165879 Sep 15 14:13:25.629940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 253/481] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:13:25 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:26.097582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:26.098196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 3ce73090-a133-4df0-a89a-3fab142222e4] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:26.110646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:26.111453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:26.112088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:26.113049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:26.113699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:26.114314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:26.132218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] HTTP exception thrown: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Request method failure captured: Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 HTTP/1.1 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzKN7VEf_gtsUSHIBo5IQLICH-ovb_IT_n9Xk5ID-fRG-oMdvms-eAyNQK0q1JT7DvU2-YfO9mEe7m616jmZDh3CfPSMzB8rmunoItpx93VfJzQbVFlvfH0vYhgk_5VnRHLaQGyg644pq3J2kkpYjEywnmfw8pyShrbPJBzgE6Abdx4 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: 1e90b31934484572bf7c7bdcbc0fdf2d Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:13:26.135794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e90b31934484572bf7c7bdcbc0fdf2d"}]}] Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: 1e90b31934484572bf7c7bdcbc0fdf2d Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-VolumesSnapshotTestJSON-2143824419-project Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 0ad0877d583d4550b9ab14ee7f4394f0 Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-VolumesSnapshotTestJSON-2143824419-project Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. Sep 15 14:13:26.138597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '3ce73090-a133-4df0-a89a-3fab142222e4'} Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:13:26.149979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. Sep 15 14:13:26.157379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:13:26.159997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Returning 404 to user: Instance 3ce73090-a133-4df0-a89a-3fab142222e4 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:13:26.159997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-28ae1ed6-b720-43d3-8428-912e3ab913b6 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4" status: 404 len: 111 microversion: 2.1 time: 0.044059 Sep 15 14:13:26.159997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 229/482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:26 2022] GET /compute/v2.1/servers/3ce73090-a133-4df0-a89a-3fab142222e4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:13:26.311878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:26.313200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:26.327824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:26.328784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:26.330893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:26.331894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:26.334402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:26.343009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:26.420286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:26.421082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:26.422110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:26.422708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lazy-loading 'fault' on Instance uuid 10e0bc0c-26d2-4261-b6e6-0cc587848266 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:13:26.485999 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:26.496640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9d55affb-3618-48b5-a839-e5e922fc5515 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 200 len: 1303 microversion: 2.1 time: 0.189548 Sep 15 14:13:26.497995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 254/483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:26 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 1303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:27.033003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:27.042844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:27.043550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:27.044183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:27.055827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] Creating event network-changed:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:13:27.062079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-a5850778-9ccc-4c35-8571-890ff0b4ff0d req-f9629ea2-3e82-4100-8768-824ae64c2930 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033095 Sep 15 14:13:27.063214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 230/484] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:27.521375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:27.522613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 10e0bc0c-26d2-4261-b6e6-0cc587848266] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:27.531403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:27.532198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:27.532830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:27.533709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:27.534298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:27.534862 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:27.551399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] HTTP exception thrown: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Request method failure captured: Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 HTTP/1.1 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzLX0HDEv37w1a2GshL7swFBFBqWicXoz26bUqPut5NZgCvdggi7nbZVj82OsMRU-pZKnhoIXR_meSkchOsygRhseaUk1xvfrLxHkziDYuKDmELnB9A6r0mJVLC9mAxTOn7nU1knVrhDxBmyRAlfKEnjygv-ASC8_7CxKohuw-P2Dgs Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 6c7cce87cd0c4e6785bd0db3abe77f27 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesActionsTest-512680620 Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:13:27.553875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7cce87cd0c4e6785bd0db3abe77f27"}]}] Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesActionsTest-512680620 Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 6c7cce87cd0c4e6785bd0db3abe77f27 Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesActionsTest-512680620 Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesActionsTest-512680620-project Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 649ca2e37c934e4cb50e59bb4765b6b7 Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesActionsTest-512680620-project Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. Sep 15 14:13:27.555473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '10e0bc0c-26d2-4261-b6e6-0cc587848266'} Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:13:27.556283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. Sep 15 14:13:27.558874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:13:27.563431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Returning 404 to user: Instance 10e0bc0c-26d2-4261-b6e6-0cc587848266 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:13:27.564726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b2dcd7b6-a330-406e-ab45-e60c1a7b2971 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266" status: 404 len: 111 microversion: 2.1 time: 0.048753 Sep 15 14:13:27.565773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 255/485] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:27 2022] GET /compute/v2.1/servers/10e0bc0c-26d2-4261-b6e6-0cc587848266 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:13:27.690823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2112889803", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "networks": [{"uuid": "7ab97aa9-0dd2-4077-90b1-e96c2e7eb1fa"}]}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:27.757866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] validate_networks() for [('7ab97aa9-0dd2-4077-90b1-e96c2e7eb1fa', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:13:28.289493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:13:28.289824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:13:28.290289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:13:28.291169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:13:28.291892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:13:28.313493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:28.316528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:28.317068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:28.317987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:28.318529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:28.319029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:28.350363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Getting quotas for project 6c7cce87cd0c4e6785bd0db3abe77f27. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:13:28.355311 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Getting quotas for user 649ca2e37c934e4cb50e59bb4765b6b7 and project 6c7cce87cd0c4e6785bd0db3abe77f27. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:13:28.367127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:13:28.369626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:13:28.438076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0da9bf79-5f98-4db7-ad3c-e583cb727ad3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751361 Sep 15 14:13:28.440512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 231/486] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:13:28.452281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5b49e486-ad60-4602-8fd5-3a039ad46d3d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:28.452895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b49e486-ad60-4602-8fd5-3a039ad46d3d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:28.570053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5b49e486-ad60-4602-8fd5-3a039ad46d3d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:28.582341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5b49e486-ad60-4602-8fd5-3a039ad46d3d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1214 microversion: 2.1 time: 0.133941 Sep 15 14:13:28.587285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 256/487] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:28 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:29.616383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:29.617776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:29.626803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:29.627610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:29.628271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:29.629166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:29.629823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:29.630432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:29.706946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:29.716503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-55f45912-ad9d-4a09-87ca-b7d96b9973d0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1218 microversion: 2.1 time: 0.104879 Sep 15 14:13:29.717582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 232/488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:29 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:30.742986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:30.745255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:30.764559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:30.765271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:30.765783 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:30.766556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:30.767079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:30.767813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:30.980472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:31.022099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-54dd04b6-56f5-41e7-8329-c4e6f8714550 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1218 microversion: 2.1 time: 0.285241 Sep 15 14:13:31.030907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 257/489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:30 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:32.055679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:32.058034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:32.075916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:32.077382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:32.078102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:32.080232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:32.082213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:32.084378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:32.481567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:32.491654 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eee1800c-a084-46ee-89e0-4d9acdbd8d28 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1284 microversion: 2.1 time: 0.440652 Sep 15 14:13:32.502035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 233/490] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:32 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1284 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:32.882040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:32.882543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:32.892220 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:32.892762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:32.893202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:32.893938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:32.894398 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:32.894819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:32.921020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-db340aa0-b691-496c-bd05-215eea8c8b79 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/ips" status: 200 len: 147 microversion: 2.1 time: 0.046245 Sep 15 14:13:32.928212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 258/491] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:13:32 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:33.516521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:33.517674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:33.524366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:33.524887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:33.525671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:33.526762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:33.527375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:33.528003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:33.904478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:33.912930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-36fa4656-5e1f-417b-8d25-d1d716a42e4b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.400120 Sep 15 14:13:33.913843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 234/492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:33 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:34.917026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa", "tag": "00901558-ee89-4015-8f41-4eaf27b606cb"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:34.937484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:34.938163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:34.938693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:34.939626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:34.940267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:34.961844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:34.962195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] Creating event network-changed:00901558-ee89-4015-8f41-4eaf27b606cb for instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa on hv-cinder-85697 Sep 15 14:13:34.962669 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:34.963187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:34.963941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:34.964406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:34.964832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:34.971397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-6672f5c0-6fe8-45dc-90ae-21cb66f335d1 req-3ef9c043-450b-4c55-ae13-22d1ea5a232b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059120 Sep 15 14:13:34.981785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 259/493] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:35.171177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:35.180961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-689751e1-2034-4275-b68a-3d4ad2f6bbcb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.245290 Sep 15 14:13:35.186540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 235/494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:34 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:36.213095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:36.213913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:36.220389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:36.220868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:36.221293 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:36.221973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:36.222419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:36.222831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:36.424996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:36.435552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3f1c3dea-3af1-4231-9470-e4a88a1311f7 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.227458 Sep 15 14:13:36.436994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 260/495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:36 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:37.459192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:37.460587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:37.469320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:37.470087 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:37.470848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:37.471838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:37.472454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:37.473412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:37.778815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:37.787966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c32c57a0-ccb3-4971-84f2-b337b8109e67 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.332515 Sep 15 14:13:37.795754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 236/496] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:37 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:38.470115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9141d3e-167a-4008-8685-ab88421560de"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:38.473619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:38.490087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:38.490636 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:38.491091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:38.491868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:38.492309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:38.492918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:38.575837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:38.692284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-673272429", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "networks": [{"uuid": "9201f9c5-6717-484a-984e-26d753a0213e"}]}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:38.701771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:38.702438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:38.703586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:38.781670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] validate_networks() for [('9201f9c5-6717-484a-984e-26d753a0213e', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:13:39.285490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:13:39.285912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:13:39.286403 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:13:39.286808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:13:39.287215 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:13:39.311101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:39.312151 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:39.312809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:39.313905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:39.314590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:39.315317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:39.349105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Getting quotas for project 1e90b31934484572bf7c7bdcbc0fdf2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:13:39.357014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Getting quotas for user 0ad0877d583d4550b9ab14ee7f4394f0 and project 1e90b31934484572bf7c7bdcbc0fdf2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:13:39.376443 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:13:39.380057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:13:39.456291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9f02579a-d8f8-4c2d-9ed9-52b9357d091a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770443 Sep 15 14:13:39.456941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 237/497] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:13:39.461572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:39.462370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:39.469447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:39.470187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:39.470779 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:39.471653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:39.472290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:39.472873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:39.659291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:39.669378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a9a502cf-4a6b-40b3-81e5-55f3eaee9495 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.211228 Sep 15 14:13:39.669968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 238/498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:39 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:39.684353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1efaa5d8-ead9-4d7c-a61b-6d8b21b5602f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:39.688761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1efaa5d8-ead9-4d7c-a61b-6d8b21b5602f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:39.767542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1efaa5d8-ead9-4d7c-a61b-6d8b21b5602f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:39.775252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1efaa5d8-ead9-4d7c-a61b-6d8b21b5602f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1218 microversion: 2.1 time: 0.101995 Sep 15 14:13:39.776828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 239/499] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:39 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:40.692638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:40.693561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:40.702407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:40.703002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:40.703510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:40.704309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:40.704823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:40.705404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:40.847833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:40.857242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7412aa6c-1916-4bca-9478-20ba650f170d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.168396 Sep 15 14:13:40.858536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 240/500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:40 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:40.863194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:40.863949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:40.870069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:40.870628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:40.871129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:40.872071 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:40.872764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:40.873411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:40.945263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:40.953372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4c0ac64e-3ab6-47a7-8dab-b41905074fea tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1222 microversion: 2.1 time: 0.093616 Sep 15 14:13:40.954175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 241/501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:40 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:41.550497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:41.715279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-35526213-ffa7-4c9e-babf-b31b99f1f5ed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.246052 Sep 15 14:13:41.723149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 261/502] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:13:38 2022] POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments => generated 194 bytes in 3258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:41.884125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:41.886092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:41.892599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:41.894687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:41.895351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:41.896164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:41.897118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:41.897790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:41.979737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:41.981117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:41.997407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:41.997995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:42.000095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:42.000888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:42.002907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:42.003569 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:42.097709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:42.106194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-aa3a5859-b4bb-4c90-8317-b288849db31a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.225945 Sep 15 14:13:42.107597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 242/503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:41 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:42.118247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:42.127857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-75acfb93-5b49-451d-a5d3-d78ceb614c3b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1270 microversion: 2.1 time: 0.153961 Sep 15 14:13:42.129621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 262/504] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:41 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:43.135276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:43.136986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:43.144988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:43.148787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:43.149864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:43.151740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:43.152593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:43.153855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:43.154202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:43.154916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:43.163075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:43.163933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:43.164586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:43.165510 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:43.166286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:43.167105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:43.236345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:43.246693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5d263eee-89db-4f04-8ede-0340db4e44dd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1276 microversion: 2.1 time: 0.096799 Sep 15 14:13:43.247458 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 263/505] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:43 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:43.420405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:43.431218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-06237dc1-a0f7-420d-ad07-1b90d0be4cdc tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.298817 Sep 15 14:13:43.433239 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 243/506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:43 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:44.270474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:44.271093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:44.282648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:44.284320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:44.286053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:44.287942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:44.289499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:44.290109 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:44.463672 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:44.464522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:44.474523 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:44.475491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:44.476312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:44.477378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:44.478387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:44.479032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:44.488483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:44.500380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-04df1a50-34d2-474a-88c5-25c3f7620f59 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.233733 Sep 15 14:13:44.504203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 264/507] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:44 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:44.513738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db30a61-493d-42cb-803b-33969d3dcf22", "tag": "87d565fd-0b4a-4e2d-a010-7a5aad16a5c7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:44.534242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:44.536838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:44.537519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:44.562656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] Creating event network-changed:87d565fd-0b4a-4e2d-a010-7a5aad16a5c7 for instance 6db30a61-493d-42cb-803b-33969d3dcf22 on hv-cinder-85697 Sep 15 14:13:44.569535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-350be788-fb18-4d56-bdde-c1309baef72b req-0bf95f11-42de-4899-b8e3-c8d6bf043a04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063547 Sep 15 14:13:44.570478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 265/508] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:44.768371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:44.781512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d66b9579-e6a7-4b76-8b60-6ea3227aa9a3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.322849 Sep 15 14:13:44.783217 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 244/509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:44 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:45.526833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:45.528469 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:45.535163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:45.537939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:45.537939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:45.538672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:45.539127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:45.539547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:45.687809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:45.695501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a19e4e9c-1e9c-4954-8307-89e87a9718e5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.173671 Sep 15 14:13:45.696368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 266/510] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:45 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:45.805624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:45.807909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:45.817261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:45.818163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:45.818599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:45.819319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:45.819797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:45.820682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:45.986527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:45.995883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6cee1ee8-c32b-4999-a099-2671b60f14d1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.193982 Sep 15 14:13:45.997253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 245/511] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:45 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:46.034464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa", "name": "network-vif-plugged", "status": "completed", "tag": "00901558-ee89-4015-8f41-4eaf27b606cb"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:46.041182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=60 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:46.046241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:46.046929 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:46.047528 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:46.065754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] Creating event network-vif-plugged:00901558-ee89-4015-8f41-4eaf27b606cb for instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa on hv-cinder-85697 Sep 15 14:13:46.073125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-2dd395b8-2acb-400c-8423-2dfe3d479626 req-4b9115e6-b3e5-4cc0-b317-e3a1287df28f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042971 Sep 15 14:13:46.074005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 267/512] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:46.611918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-df0a1ae2-47fe-4dc2-bf3f-c7cc07b3f8f8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'create', calling method: .version_select at 0x7fab47994040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2063758999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7z5nCudygUdt2OsvEcfIpAY5/u+FBt74uCXk8esd/X3JUpRyzxe85lVdTpbisetSnq98GXJg0CpaSLMoI6xnj4KDeG0x+asTtW8h5YjiGzCK1mixGirnas5BomEFkaCA=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:46.627614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-df0a1ae2-47fe-4dc2-bf3f-c7cc07b3f8f8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Getting quotas for project 2d56d6c8fce14f2f9fe424a5d0ae2046. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:13:46.631416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-df0a1ae2-47fe-4dc2-bf3f-c7cc07b3f8f8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Getting quotas for user 2bf8e22b8bb2459b83d1c065c0da7145 and project 2d56d6c8fce14f2f9fe424a5d0ae2046. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:13:46.653495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-df0a1ae2-47fe-4dc2-bf3f-c7cc07b3f8f8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045566 Sep 15 14:13:46.654081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 246/513] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:13:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:46.706377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-492737252", "imageRef": "27f475fe-de76-46f6-a585-ca7cbf6dfcbe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2063758999", "networks": [{"uuid": "9929a618-46ec-43e0-9a7a-ac3572079a97"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:46.719671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:46.720305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:46.726759 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:46.727004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:46.727522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:46.728237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:46.728712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:46.729119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:46.745023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:46.758832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] validate_networks() for [('9929a618-46ec-43e0-9a7a-ac3572079a97', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:13:46.861324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:46.870028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b38ae8a1-c9c8-4c40-80fe-eaf160b45ae8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.154090 Sep 15 14:13:46.870601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 247/514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:46 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:47.020127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:47.020892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:47.026697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.027184 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.027610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:47.028335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.028788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.029210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:47.133914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:13:47.134637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:13:47.135143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:13:47.135765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:13:47.136182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:13:47.145822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.146306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.146740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:47.147462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.148590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.149016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:47.159949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:47.168277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ebe6f99b-51e8-4ae6-9e17-0df38e0783e3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.152085 Sep 15 14:13:47.169103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 248/515] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:47 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:47.175382 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Getting quotas for project 2d56d6c8fce14f2f9fe424a5d0ae2046. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:13:47.179614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Getting quotas for user 2bf8e22b8bb2459b83d1c065c0da7145 and project 2d56d6c8fce14f2f9fe424a5d0ae2046. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:13:47.190819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:13:47.193212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27f475fe-de76-46f6-a585-ca7cbf6dfcbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:13:47.240883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8bad785f-52c7-428e-86bc-5b671296e4aa tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538697 Sep 15 14:13:47.241518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 268/516] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:13:47.252713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8d3dffd9-87d9-45b0-ab9b-39883e99a37b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:47.253351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8d3dffd9-87d9-45b0-ab9b-39883e99a37b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:47.309276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8d3dffd9-87d9-45b0-ab9b-39883e99a37b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:47.316712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8d3dffd9-87d9-45b0-ab9b-39883e99a37b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1258 microversion: 2.1 time: 0.067452 Sep 15 14:13:47.317048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 249/517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:47 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:47.892989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:47.893526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:47.901184 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.901767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.902200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:47.902877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:47.903325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:47.903759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:48.031798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:48.039408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-52b003c9-2b7d-40c9-866c-ae30bf5810c0 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.150789 Sep 15 14:13:48.040000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 269/518] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:47 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:48.193139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:48.193743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:48.200838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:48.201326 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:48.201764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:48.202466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:48.202916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:48.203337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:48.336376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:48.338593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:48.339210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:48.344594 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4a57d2b5-2e03-4b36-99bc-055afaca11c3 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.155387 Sep 15 14:13:48.345003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:48.345322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 250/519] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:48 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:48.345486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:48.345922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:48.346691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:48.347152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:48.347575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:48.410352 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:48.418841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-502a3ab2-d257-45dd-9c0c-8744f30f61d2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1262 microversion: 2.1 time: 0.084094 Sep 15 14:13:48.419418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 270/520] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:48 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:49.062466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:49.063074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:49.068965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.069454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.069894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.070601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.071042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.071464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.312434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:49.322356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bac776fe-65e4-447b-b990-46f59118885c tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.263382 Sep 15 14:13:49.323173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 251/521] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:49 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:49.368182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:49.369900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:49.376456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.376943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.377374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.378070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.378522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.378944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.442786 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:49.443511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:49.445438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:49.452002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.452570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.453073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.453777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:49.454228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:49.454651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:49.521504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:49.529232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9a8d56de-4a89-44fc-80a6-9b14275c56fd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1254 microversion: 2.1 time: 0.090296 Sep 15 14:13:49.530021 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 252/522] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:49 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:49.540504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:49.548589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ff12d350-b0a4-4e82-bac8-7d58aa271275 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.184246 Sep 15 14:13:49.549157 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 271/523] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:49 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:50.345990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:50.347458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:50.353849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.354376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.354823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.359992 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.360625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.361128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.437564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:50.444194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.444681 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.445122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.498136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:50.505754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1ae8f7f8-12b8-48a6-845b-9ae5a778af73 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.164152 Sep 15 14:13:50.506326 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 253/524] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:50 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:50.506497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Going to try to stop instance {{(pid=120648) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 14:13:50.550306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-40601feb-cb86-4d43-a66e-2747b9deafea tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.116884 Sep 15 14:13:50.550913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 272/525] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:13:50 2022] POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:13:50.552086 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:50.552696 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:50.559818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:50.560120 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.560519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:50.560620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.561082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.561970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.562417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.562835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.567991 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.567991 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.567991 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.568331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.568776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.569199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.625400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:50.634990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f79da909-cec8-4704-8c1d-3102773b50ee tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1310 microversion: 2.1 time: 0.086697 Sep 15 14:13:50.635768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 254/526] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:50 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:50.640682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:50.641401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:50.647452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.648135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.648674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.649619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:50.650485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:50.651358 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:50.729348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:50.737960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3655a1c7-8405-4227-bcc2-0876fabdd352 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.182642 Sep 15 14:13:50.746449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 273/527] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:50 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:50.821554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:50.829682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1990ed01-1ac5-4b0e-af44-2912d4675c0a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.192597 Sep 15 14:13:50.830414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 255/528] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:50 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:51.529702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:51.530244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:51.536844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.537362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.537789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.538469 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.538919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.539331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.658553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:51.659162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:51.666361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.667082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.667702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.668441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.668873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.669300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.674896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:51.684039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-da23bf73-3651-421b-9c24-5d9165056c00 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.158160 Sep 15 14:13:51.684714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 274/529] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:51 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:51.748262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:51.755821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a2e56df0-dc44-46a0-8515-e7e39b4c53b7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1310 microversion: 2.1 time: 0.101085 Sep 15 14:13:51.756335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 256/530] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:51 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:51.761488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:51.762096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:51.767986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.768460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.768888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.769561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.770006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.770419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.852942 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:51.854188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:51.860458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.861019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.861520 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.862290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:51.863107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:51.863310 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:51.903239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:51.911583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d74ca866-7308-4000-95c7-abd8c973dfed tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.154199 Sep 15 14:13:51.912190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 275/531] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:51 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:52.067662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:52.076081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-06ef149b-f05a-4ce8-8dc1-eef3bfaba7a9 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1314 microversion: 2.1 time: 0.227101 Sep 15 14:13:52.076638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 257/532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:51 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:52.297096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db30a61-493d-42cb-803b-33969d3dcf22", "name": "network-vif-plugged", "status": "completed", "tag": "87d565fd-0b4a-4e2d-a010-7a5aad16a5c7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:52.307144 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.308923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.309517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.324414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] Creating event network-vif-plugged:87d565fd-0b4a-4e2d-a010-7a5aad16a5c7 for instance 6db30a61-493d-42cb-803b-33969d3dcf22 on hv-cinder-85697 Sep 15 14:13:52.329555 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-ac38b56c-3573-4899-b47f-5990eb699887 req-3d7e70b5-0797-43de-be4d-e0132f870895 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036954 Sep 15 14:13:52.330149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 276/533] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:52.707370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:52.708004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:52.715077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.715656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.716117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.716804 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.717262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.717671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.780000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:52.780923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:52.787553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.788063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.788487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.789202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.789628 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.790072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.854061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:52.854434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:52.862208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4c148ab0-90de-4004-baa4-af0a59b6f520 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1310 microversion: 2.1 time: 0.087165 Sep 15 14:13:52.862427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4be32d11-1c33-45f0-95c9-f53704391792 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.158849 Sep 15 14:13:52.867725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 277/534] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:52 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:52.872334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 258/535] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:52 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:52.935851 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:52.936487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:52.942668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.943153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.943587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:52.944295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:52.944747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:52.945167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.078422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:53.086584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a301e821-a386-46b5-b718-f87bbe4988d4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.154822 Sep 15 14:13:53.087152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 278/536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:52 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:53.099469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:53.100191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:53.106218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.106699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.107135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.107864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.108321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.108740 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.241377 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:53.250161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bef06bf1-e72b-4a7d-bd09-63f4da71aa09 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1498 microversion: 2.1 time: 0.154531 Sep 15 14:13:53.250735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 259/537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:53 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:53.886972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:53.887603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:53.891407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:53.892141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:53.903424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.907148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.907793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.908656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.909130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.909870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.910333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.910747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.915452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:53.916317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:53.917901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:53.918685 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:53.919272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.014737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:54.023764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e16a2a1f-66e1-4a4c-a2f5-2132027e532d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1328 microversion: 2.1 time: 0.142420 Sep 15 14:13:54.024749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 279/538] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:53 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:54.032438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:54.033053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:54.039220 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.040253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.040424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.041018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.041461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.041878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.069475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:13:54.143320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:54.152891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6b5a738d-1563-49a6-8b22-673dfbe8abf8 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.269691 Sep 15 14:13:54.153464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c24ae86a-210c-4da5-8a7d-e72f5e9b857b tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "DELETE /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 204 len: 0 microversion: 2.1 time: 0.124513 Sep 15 14:13:54.153607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 260/539] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:53 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:54.155718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 280/540] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:13:54 2022] DELETE /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:13:54.158242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:54.158848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:54.164598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.165118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.165532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.166222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.166677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.167102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.169699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:54.170399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:54.176424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.176903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.177361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.178043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:54.178489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:54.178906 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:54.302950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:54.311414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-00aeceb0-0fa1-448d-92bd-1d0ac2a8dfb6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.156862 Sep 15 14:13:54.312308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 261/541] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:54 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:54.313272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:54.320954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8c26d78a-832b-4d1d-a89d-51253760c96c tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.155649 Sep 15 14:13:54.321514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 281/542] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:54 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:55.047870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:55.048480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:55.054765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.055247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.055698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.056385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.056838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.057259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.117972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:55.125492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-613ea47e-9052-4dae-8e56-630714ed0d98 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1316 microversion: 2.1 time: 0.081537 Sep 15 14:13:55.126049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 262/543] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:55 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1316 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:55.175341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:55.175915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:55.182183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.182687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.183145 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.183877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.184346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.184766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.310983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:55.318825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-acce12cc-af4d-4eb9-b599-c555ae9f1515 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.147321 Sep 15 14:13:55.319384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 282/544] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:55 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:55.334206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:55.334853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:55.341630 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.342118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.342556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.343248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.343724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.343824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:55.344198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.344378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:55.350208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.350679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.351103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.351815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:55.352260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:55.352675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:55.479403 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:55.480895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:55.488699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3b298914-ebfd-4d8c-b250-fc12ccdeb949 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.158237 Sep 15 14:13:55.488878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b7bcb8ab-fd1b-4c50-8820-022614c44d49 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.148866 Sep 15 14:13:55.489284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 263/545] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:55 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:55.489425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 283/546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:55 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:56.148529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:56.149170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:56.155559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.156072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.156506 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.157196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.157659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.158073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.225431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:56.233447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ec9450e3-f6a0-45cd-9533-f467ecd1dca8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1316 microversion: 2.1 time: 0.088816 Sep 15 14:13:56.234021 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 264/547] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:56 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:56.342875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:56.343492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:56.349967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.350451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.350882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.351575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.352071 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.352490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.498377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:56.507463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-36a3ac09-f450-456b-9a2b-0db58bbda8b5 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1318 microversion: 2.1 time: 0.168604 Sep 15 14:13:56.508393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 284/548] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:56 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:56.513054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:56.513665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:56.514731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:56.515428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:56.521659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.522414 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.523205 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.524166 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.525285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.525812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.529434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.530054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.530506 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.531495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:56.531899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:56.532323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:56.538402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:56.679410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:56.687982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e28a550-6eb4-455c-9737-6113dc243248 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.178110 Sep 15 14:13:56.688908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 285/549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:56 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:56.694863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:56.705273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3d33680b-82aa-4f92-95ac-340e6a1164ef tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.196874 Sep 15 14:13:56.705963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 265/550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:56 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:57.256986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:57.257642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:57.259625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:57.260320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:57.267591 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.268140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.269204 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.269921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.270605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.270797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.424224 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:57.444096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-17600462-c865-433a-9e4d-38559fef3fc4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.187512 Sep 15 14:13:57.446370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 286/551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:57 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:57.525843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=14 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:13:57.531799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:57.534692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:57.535314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:57.541624 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.542932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.543176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.543654 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.544007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.544119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.545354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.546606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.547213 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.557158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] Creating event network-changed:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:13:57.563985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-50cdc262-3d4d-4059-be73-73568bc0dd26 req-5c133195-f24e-40be-b414-c5e4e8ce0ae2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039120 Sep 15 14:13:57.564969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 266/552] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:13:57.712591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:57.713291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:57.716629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:57.719755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.720462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.720906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.721608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.722097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.722527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.725171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-88e796a1-da50-4fff-85ba-b4e492a49dac tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1507 microversion: 2.1 time: 0.194784 Sep 15 14:13:57.726373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 287/553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:57 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:57.732059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:57.732979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:57.739192 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.739936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.740375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.741078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.741531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.741949 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.904544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:57.913187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0da6928c-db2d-46b0-b01c-88bc6b6bd83e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.185525 Sep 15 14:13:57.913778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 288/554] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:57 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:57.916953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:57.923005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3959fdd-178d-41c8-b600-fa1d429faea5", "device": "/dev/sdb"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:13:57.925835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:57.927259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f407e112-6183-44d8-9e74-ea72cb8925a1 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.218796 Sep 15 14:13:57.928609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 267/555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:57 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:57.934343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.934923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.935520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:57.937085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:57.937701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:57.938597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:58.470484 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:58.471124 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:58.477788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:58.478280 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:58.478723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:58.479418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:58.480466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:58.480898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:58.622402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:58.630283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-949fcce8-1de2-448e-8170-13e37af54997 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.163640 Sep 15 14:13:58.630978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 268/556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:58 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:58.939117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:58.939637 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:58.946029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:58.946530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:58.947061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:58.947806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:58.948288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:58.948920 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:59.095318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:59.106324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-171367f1-b7a4-48bf-8de1-4a807bc2bc03 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.171581 Sep 15 14:13:59.106896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 269/557] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:58 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:13:59.112605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:59.113589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:59.120079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:59.120804 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:59.121692 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:59.122428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:59.122957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:59.123494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:59.260661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:59.268716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d76e4c96-0588-453d-a932-7b5717aad7a0 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.160856 Sep 15 14:13:59.269279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 270/558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:59 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:13:59.654435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:13:59.655082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:13:59.661474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:59.661943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:59.662371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:59.663047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:13:59.663493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:13:59.663933 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:13:59.801081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:13:59.809050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a770d7f2-461b-47f5-b6e4-10920da817d8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.159287 Sep 15 14:13:59.809641 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 271/559] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:13:59 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:00.133453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:00.134052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:00.140069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.140550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.140979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.141656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.142105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.142526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.283064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:00.296351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-329bc2c2-e2dc-40dd-b01c-ced6d4580c09 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.166594 Sep 15 14:14:00.297505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 272/560] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:00 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:00.302445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:00.303149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:00.305241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:00.325353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.325852 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.326352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.327298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.327517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.328218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.484027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:00.491651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-75169b55-a010-4173-b122-6c99c1546d9f tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.193006 Sep 15 14:14:00.492238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 273/561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:00 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:00.496582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa", "name": "network-vif-unplugged", "status": "completed", "tag": "00901558-ee89-4015-8f41-4eaf27b606cb"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:00.505962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.506441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.506870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.518727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] Creating event network-vif-unplugged:00901558-ee89-4015-8f41-4eaf27b606cb for instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa on hv-cinder-85697 Sep 15 14:14:00.524294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-ff074c3f-b6f2-473c-958b-83e88e372928 req-15d3c2d9-c600-42bd-918e-e192f68cacbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030919 Sep 15 14:14:00.524902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 274/562] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:00.832924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:00.833644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:00.840704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.841194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.841636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.842335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:00.842789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:00.843211 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:00.978396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:00.986921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2f00741f-9b82-4b5b-8dcc-fd0e263c6147 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.158659 Sep 15 14:14:00.987750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 275/563] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:00 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:01.322421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:01.323114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:01.329618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:01.330102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:01.330535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:01.331227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:01.331679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:01.332123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:01.468176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:01.476771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3ce9f243-355a-45e3-9fcb-8e8f6f4db592 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.158219 Sep 15 14:14:01.477346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 276/564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:01 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:01.514919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:01.515642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:01.521956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:01.522520 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:01.523036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:01.523834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:01.524360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:01.524846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:01.661157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:01.669501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6d43fff7-cf10-40a6-aed5-6b0083ea4b0e tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.158535 Sep 15 14:14:01.670081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 277/565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:01 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:02.009721 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:02.010381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:02.018029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.018617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.019217 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.019939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.020510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.021073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.155971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:02.163556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5dcdf58e-0176-4b1a-b8d8-80075773be8b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.157766 Sep 15 14:14:02.164143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 278/566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:02 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:02.501163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:02.501777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:02.507595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.508110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.508542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.509226 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.509681 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.510107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.644575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:02.652761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-36d461de-8c2a-463c-af19-56d97187b052 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.155447 Sep 15 14:14:02.653322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 279/567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:02 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:02.692716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:02.693329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:02.699556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.700107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.700550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.701249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:02.701861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:02.702285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:02.834276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:02.843445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4358d703-13a1-4384-9032-c4a747fd94fb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.154428 Sep 15 14:14:02.844049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 280/568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:02 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:03.187619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:03.188348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:03.194874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.195364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.195828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.196524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.197013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.197441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.331289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:03.339114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-06bdadb3-5a8e-4519-b420-2ddb49b73430 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.156490 Sep 15 14:14:03.339918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 281/569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:03 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:03.677116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:03.677730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:03.683633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.684159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.684591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.685273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.685729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.686153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.822457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:03.831126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6a3fbbd2-b33d-473f-bddc-7b3aee7c8e31 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.157834 Sep 15 14:14:03.831708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 282/570] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:03 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:03.866263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:03.866867 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:03.873037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.873518 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.873963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.874652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:03.875106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:03.875531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:03.882235 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:04.008896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:04.017589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-73cc3942-3e73-49b6-a1ca-ee5f2c70f318 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.155075 Sep 15 14:14:04.018480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 283/571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:03 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:04.362050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:04.362724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:04.369107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:04.369597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:04.370034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:04.371239 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:04.371709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:04.372149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:04.505642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:04.513667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-550c18ff-b68d-413e-884c-3e63bfb4910c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.155536 Sep 15 14:14:04.514242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 284/572] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:04 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:04.855163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:04.856750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:04.862709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:04.863185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:04.863613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:04.864312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:04.864760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:04.865177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:05.005350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:05.014885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b51ac893-a99c-4e6c-aeb7-bbb0e8ef4950 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.164340 Sep 15 14:14:05.015790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 285/573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:04 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:05.041577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:05.042185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:05.049329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:05.049885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:05.050392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:05.051150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:05.051667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:05.052196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:05.189234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:05.199011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a2808c26-e02f-4e68-ad20-e64aedddf5a5 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.160935 Sep 15 14:14:05.200792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 286/574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:05 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:05.537162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:05.537835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:05.544288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:05.544771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:05.545206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:05.545903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:05.546360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:05.546787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:05.685104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:05.695080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-95f73312-5c4d-4300-8d91-89b74319004a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.161716 Sep 15 14:14:05.695644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 287/575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:05 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:06.038291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:06.038928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:06.045077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.045562 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.045999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.046697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.047150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.047572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.181912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:06.191395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b111d9b5-9456-4a42-a2b8-adc975959e4f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.156870 Sep 15 14:14:06.192026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 288/576] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:06 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:06.224059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:06.224691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:06.231543 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.232280 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.232727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.233425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.233902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.234300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.373801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:06.381585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1e9a1de1-1afa-474a-83ca-1f47499f42c6 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.161278 Sep 15 14:14:06.382421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 289/577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:06 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:06.607905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:06.608592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:06.614702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.615187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.615626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.616346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.616806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.617229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.642414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-845a0f15-957f-48b6-aba7-721f1a27537e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/ips" status: 200 len: 150 microversion: 2.20 time: 0.038568 Sep 15 14:14:06.642993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 290/578] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 15 14:14:06 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:14:06.718381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:06.719603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:06.726062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.726634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.727273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.728095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:06.729026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:06.729540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:06.877373 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:06.886126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-812963eb-3c5f-471f-be37-2deaeff55c21 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.172050 Sep 15 14:14:06.887752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 291/579] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:06 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:07.214369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:07.215782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:07.222598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.223092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.223531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.224364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.224820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.225241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.361196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:07.369591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-17cac5a3-6679-4437-9bda-88f381d12bda tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.159050 Sep 15 14:14:07.370225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 292/580] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:07 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:07.405718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:07.406327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:07.412861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.413364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.413807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.414542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.414999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.415454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.565400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:07.573586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c7ccacd6-b658-44f4-9133-2da947ebed5a tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.172264 Sep 15 14:14:07.574172 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 293/581] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:07 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:07.908560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:07.909203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:07.915509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.916034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.916475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.917163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:07.917621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:07.918047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:07.933576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:08.050312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:08.063842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:08.073091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-464c429f-c6f1-4c52-b65f-a60d846051f4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.168293 Sep 15 14:14:08.073718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 294/582] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:07 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:08.393699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:08.394305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:08.400315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:08.400796 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:08.401231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:08.401945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:08.403058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:08.403498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:08.540645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:08.549378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f7872d9b-f76f-4f6a-a347-47e3652fdab7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.159497 Sep 15 14:14:08.549941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 295/583] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:08 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:08.597195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:08.597818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:08.603971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:08.604464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:08.604931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:08.606170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:08.606684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:08.607111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:08.744169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:08.752821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9e63c3b7-d023-407e-a7c1-72f0f2573555 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.159952 Sep 15 14:14:08.753391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 296/584] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:08 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:09.100832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:09.101547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:09.108807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.109295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.109737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.110437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.110892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.111320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.249477 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:09.257413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-930e2c08-08a6-4b87-a520-88eb2638ba0d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.160363 Sep 15 14:14:09.258259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 297/585] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:09 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:09.573395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:09.573930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:09.580522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.581009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.581457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.582151 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.582676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.583044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.714273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:09.723148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1cbc9686-fad9-4c2f-8719-9c54e575ebd5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.153645 Sep 15 14:14:09.723742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 298/586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:09 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:09.728309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:09.728839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:09.735319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.735923 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.736271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.736971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:09.737426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:09.737854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:09.761038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lazy-loading 'flavor' on Instance uuid 66c972aa-5fee-4e35-a30f-dd5e48f7d108 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:14:09.817211 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:09.992176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8e1748d1-3206-4c35-80b7-4702457cdd9a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/action" status: 202 len: 0 microversion: 2.20 time: 0.267172 Sep 15 14:14:09.993069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 299/587] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 15 14:14:09 2022] POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:14:10.002289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:10.002984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:10.010044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.010539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.010979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.011677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.012154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.012583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.153014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.161188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c56ffdd8-ce4b-4d40-a59f-6714ee8f3085 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.162971 Sep 15 14:14:10.161765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 300/588] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:09 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:10.166219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:10.166814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:10.173523 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.174013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.174456 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.175155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.175610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.176066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.317475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.325779 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.327261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.328450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2825b0d5-8001-4b41-b30d-9a4d9b43c090 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.165766 Sep 15 14:14:10.329009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 301/589] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:10 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:10.333279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:10.333884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:10.339313 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.339827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.340263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.341491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.341945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.342369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.471250 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.478971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e589377b-4777-4b1a-96b2-d44b7633ec52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.149015 Sep 15 14:14:10.479531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 302/590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:10 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:10.746516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:10.748028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:10.754160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.754670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.755115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.755831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:10.756292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:10.756719 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:10.891122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:10.899392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-53397bfc-a21f-4064-b5d4-db07bb68d281 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.156822 Sep 15 14:14:10.899999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 303/591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:10 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:11.187846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:11.188517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:11.194913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.195403 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.195861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.196552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.197001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.197414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.331175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:11.339034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-122512ae-d66f-4fcb-bb0c-59704ca8f928 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.156272 Sep 15 14:14:11.339595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 304/592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:11 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:11.353981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:11.354580 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:11.360483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.360958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.361388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.362060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.362505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.362922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.498544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:11.506526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:11.507991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:11.509141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6dcc6066-acc9-4ff7-b905-3ba121dba8f2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.158864 Sep 15 14:14:11.509695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 305/593] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:11 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:11.514400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:11.514999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:11.521041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.521527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.521961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.522658 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.523110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.523532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.655758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:11.663226 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5ff5743d-f12b-4444-921c-96c0f866ab7e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.152604 Sep 15 14:14:11.663822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 306/594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:11 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:11.923107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:11.923736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:11.929666 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.930161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.930599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:11.931288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:11.931769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:11.932198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.061713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.070243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0a39c773-af77-44bc-aa73-9a08d903990c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.151622 Sep 15 14:14:12.070808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 307/595] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:11 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:12.362249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:12.362857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:12.368842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.369325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.369782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.370465 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.370921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.371350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.508488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.516627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-74e42794-7a15-4274-84e0-ae199b677294 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.158221 Sep 15 14:14:12.517200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 308/596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:12 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:12.535231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:12.535872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:12.541510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.541982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.542407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.543082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.543527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.543969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.672511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.680618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.682008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.683156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8f36f64f-7921-47fc-a882-635bd6df7594 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.151544 Sep 15 14:14:12.683724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 309/597] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:12 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:12.688787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:12.689384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:12.695052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.695627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.696111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.696788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:12.697234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:12.697758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:12.828122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:12.835541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a18a1d88-ccaa-421b-8d7d-1cc3f02142e7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.150890 Sep 15 14:14:12.836136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 310/598] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:12 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:13.093955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:13.094555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:13.100443 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.100921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.101352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.102028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.102479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.102895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.227050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.236084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ed00ec1e-5f35-4783-9429-42ad23a932f9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.146715 Sep 15 14:14:13.236640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 311/599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:13 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:13.540246 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:13.540944 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:13.547959 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.548445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.548879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.549574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.550030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.550451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.681020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.688967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-62efa1e1-b05d-4329-83c6-6904c8615017 tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.152578 Sep 15 14:14:13.689527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 312/600] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:13 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:13.709577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:13.710114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:13.716379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.716861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.717298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.717989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.718444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.718871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.846773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.854728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.856214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.857489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e0697ea3-712d-46ae-916d-aff458cbb3b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.151643 Sep 15 14:14:13.858048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 313/601] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:13 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:13.862317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:13.862915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:13.868517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.868994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.869429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.870109 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:13.870561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:13.870982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:13.997248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:13.999539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:14.006812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e0dc2473-ada2-4864-9dd9-215d0286cfa9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.147792 Sep 15 14:14:14.007418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 314/602] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:13 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:14.260020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:14.260568 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:14.267973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.268457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.268889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:14.269569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.270018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.270441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:14.401809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:14.410171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-073f9196-dafd-4d1a-aa78-49e53562f7c4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1724 microversion: 2.1 time: 0.154130 Sep 15 14:14:14.410765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 315/603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:14 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:14.712874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:14.713602 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:14.721329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.721847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.722269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:14.722956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.723405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.723860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:14.877831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:14.884514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c22ebf62-afd9-43b0-9416-b08622b7b7ae tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1504 microversion: 2.1 time: 0.175644 Sep 15 14:14:14.885191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 316/604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:14 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:14.890111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:14.890545 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:14.896428 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.897000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.897514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:14.898590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:14.898952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:14.899608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.070892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.079010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.080679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.082025 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fea7e1e5-2f12-4e46-8ea1-beeae62abc42 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.195719 Sep 15 14:14:15.082968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 317/605] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:14 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:15.093928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa", "name": "network-vif-deleted", "tag": "00901558-ee89-4015-8f41-4eaf27b606cb"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:15.105093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.105646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.106067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.119891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] Creating event network-vif-deleted:00901558-ee89-4015-8f41-4eaf27b606cb for instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa on hv-cinder-85697 Sep 15 14:14:15.125491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-47783dc2-b698-434b-b898-a6282d401ba5 req-550cde95-7028-4dcb-9512-8de6d0a98570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035555 Sep 15 14:14:15.126289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 318/606] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:15.131772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:15.132466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:15.138995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.139566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.140107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.140894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.141391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.141767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.288992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b126125b-5e7f-4037-bd28-ca99b6921b83 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "POST /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.370234 Sep 15 14:14:15.289649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 289/607] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:13:57 2022] POST /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22/os-volume_attachments => generated 194 bytes in 17375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:15.324330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.332479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-aa30cf1b-32ca-4142-bae2-3b87b7705330 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.204901 Sep 15 14:14:15.333150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 319/608] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:15 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:15.434404 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:15.435505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:15.442245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.442719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.443147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.443852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.444304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.444726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.581712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.590038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f09745d-8b65-4851-9eb2-833df360856c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1701 microversion: 2.1 time: 0.159869 Sep 15 14:14:15.590607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 290/609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:15 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:15.612559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:15.618453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.618939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.619406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.679679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Going to try to start instance {{(pid=120647) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 14:14:15.720251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b339db67-7453-40f2-b002-d6d15219c470 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.111318 Sep 15 14:14:15.720833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 320/610] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:14:15 2022] POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:14:15.728870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:15.729480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:15.736102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.736585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.737021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.737710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.738163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.738583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.874017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:15.882700 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-239fee07-7b90-4ee2-9c44-1dc324b51002 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.157673 Sep 15 14:14:15.883266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 291/611] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:15 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:15.909686 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:15.910387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:15.916551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.917068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.917509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.918204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.918660 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.919765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.953606 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:15.954098 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:15.954540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:15.954990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lazy-loading 'fault' on Instance uuid 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:14:15.995802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649ca2e37c934e4cb50e59bb4765b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7cce87cd0c4e6785bd0db3abe77f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:16.008213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dcc3eb44-84c8-441c-bccd-9d70c04af1cb tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 200 len: 1304 microversion: 2.1 time: 0.102759 Sep 15 14:14:16.010364 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 321/612] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:15 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:16.110523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:16.111813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:16.118305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.118820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.119316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:16.120074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.120529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.121006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:16.279590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:16.288611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:16.290051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:16.291227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b9303d6d-88f0-4e52-9f61-697072c1ed31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.185469 Sep 15 14:14:16.292336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 292/613] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:16 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:16.355119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:16.356048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:16.363060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:16.365072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.365577 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.366111 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:16.366878 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.367579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.368451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:16.515383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:16.524270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-27d71ac4-fe2a-48de-a296-693de6753b08 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.173162 Sep 15 14:14:16.524847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 322/614] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:16 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:16.905194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:16.905807 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:16.911816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.912301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.912738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:16.913427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:16.913884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:16.914315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.032062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:17.032771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] [instance: 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:17.039078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.039554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.040047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.040734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.041180 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.041599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.042850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:17.052119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5b670a6c-30cd-403f-a61b-f4d2701324e4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.150937 Sep 15 14:14:17.052693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 293/615] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:16 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:17.055744 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] HTTP exception thrown: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Request method failure captured: Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa HTTP/1.1 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzLX0HDEv37w1a2GshL7swFBFBqWicXoz26bUqPut5NZgCvdggi7nbZVj82OsMRU-pZKnhoIXR_meSkchOsygRhseaUk1xvfrLxHkziDYuKDmELnB9A6r0mJVLC9mAxTOn7nU1knVrhDxBmyRAlfKEnjygv-ASC8_7CxKohuw-P2Dgs Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: 6c7cce87cd0c4e6785bd0db3abe77f27 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-VolumesActionsTest-512680620 Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:14:17.057413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7cce87cd0c4e6785bd0db3abe77f27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7cce87cd0c4e6785bd0db3abe77f27"}]}] Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-VolumesActionsTest-512680620 Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: 6c7cce87cd0c4e6785bd0db3abe77f27 Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-VolumesActionsTest-512680620 Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-VolumesActionsTest-512680620-project Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 649ca2e37c934e4cb50e59bb4765b6b7 Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-VolumesActionsTest-512680620-project Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. Sep 15 14:14:17.059068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa'} Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:14:17.060603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. Sep 15 14:14:17.061873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:17.063248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] Returning 404 to user: Instance 596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:14:17.063248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a0182163-d60f-4c5e-b3aa-b2fea0886d7d tempest-VolumesActionsTest-512680620 tempest-VolumesActionsTest-512680620-project] 10.222.0.27 "GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa" status: 404 len: 111 microversion: 2.1 time: 0.030950 Sep 15 14:14:17.063248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 323/616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:17 2022] GET /compute/v2.1/servers/596b4be3-deaa-43fb-ac5d-bbe2e0fc93aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 14:14:17.316951 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:17.317561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:17.323946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.324426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.325003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.326234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.326691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.327105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.467094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:17.475640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:17.477670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:17.478775 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e20857ad-fa9b-4896-a2d4-7b57c4febd3a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.165647 Sep 15 14:14:17.480085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 294/617] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:17 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:17.547936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:17.548690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:17.554989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.555616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.556143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.556911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:17.557436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:17.557945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:17.915576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:17.924107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-66264a55-b99e-4af7-a634-2bf953d7e00c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.380204 Sep 15 14:14:17.924655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 324/618] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:17 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:18.077079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:18.077689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:18.083823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.084300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.084726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:18.085438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.085886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.086305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:18.218712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:18.226845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6bb4fce-013d-46c9-84a9-fa50d3d9b55e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.153655 Sep 15 14:14:18.227412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 295/619] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:18 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:18.504873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:18.505505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:18.512155 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.513464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.513920 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:18.514628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.515081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.515498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:18.642884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:18.650902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:18.652395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:18.654104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-acc7a26d-8797-4d1f-86ac-e131691a40ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.152485 Sep 15 14:14:18.654669 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 325/620] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:18 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:18.947576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:18.948248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:18.955062 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.955540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.956010 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:18.956697 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:18.957173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:18.957595 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:19.086833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:19.095096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d52f43a1-1c36-4614-8868-f7cc23bb6f91 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.151309 Sep 15 14:14:19.095679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 296/621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:18 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:19.249446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:19.250059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:19.256107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:19.256596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:19.257031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:19.257720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:19.258210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:19.258634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:19.393799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:19.401896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-59cd96f7-393e-4ebb-a15e-9f6b619ac4eb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.156364 Sep 15 14:14:19.402462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 326/622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:19 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:19.680367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:19.681003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:19.687755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:19.688234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:19.688662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:19.689346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:19.689794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:19.690223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:19.816093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:19.824021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:19.825653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:19.826796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5931cdeb-fe17-436b-b473-764b8f01e321 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.150318 Sep 15 14:14:19.827356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 297/623] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:19 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:20.117381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:20.117911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:20.124547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.125023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.125454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.126132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.126579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.127000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.252154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:20.259673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e15f6d66-2eff-45bd-b533-c8fdcf0ddb6c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.146199 Sep 15 14:14:20.260260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 327/624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:20 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:20.425477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:20.426020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:20.432548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.433035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.433479 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.434168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.434870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.435299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.562863 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:20.571223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-df586231-c380-4afa-8938-c3d77094309b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.149696 Sep 15 14:14:20.571805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 298/625] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:20 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:20.852112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:20.852714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:20.859544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.860043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.860472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.861144 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:20.861588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:20.862000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:20.992302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:21.001088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:21.002513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:21.003646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6da9b0d3-1c40-458e-b0ee-b3d397f6d2c6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.155362 Sep 15 14:14:21.004231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 328/626] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:20 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:21.282894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:21.283494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:21.289326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:21.289799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:21.290226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:21.290899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:21.291344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:21.291782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:21.423492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:21.431466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cd0778c9-31ea-4d43-84b1-ee4a06cfeaba tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.153308 Sep 15 14:14:21.432069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 299/627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:21 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:21.594902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:21.595451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:21.601813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:21.602284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:21.602710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:21.603381 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:21.603863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:21.604279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:21.731671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:21.739823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-06e56b40-a0f3-49c6-b6a8-e3b3dcae3031 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.149056 Sep 15 14:14:21.740379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 329/628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:21 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:22.029964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:22.030571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:22.036561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.037047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.037480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.038166 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.038619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.039045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.165159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:22.173123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:22.174576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:22.175965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a547bd6c-706b-41e5-93ed-0b6e14aaae7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.150535 Sep 15 14:14:22.176531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 300/629] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:22 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:22.454436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:22.454991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:22.461707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.462186 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.462644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.463325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.463801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.464228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.590469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:22.598101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-57056e59-3597-4856-898b-a8563f44357e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.147639 Sep 15 14:14:22.598686 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 330/630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:22 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:22.763877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:22.764495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:22.770820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.771296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.771747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.772434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:22.772914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:22.773331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:22.902707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:22.911031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ea2ae928-b487-45c5-8e1d-97ae44e32bb9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.151192 Sep 15 14:14:22.911608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 301/631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:22 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:23.202579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:23.203103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:23.209452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.209924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.210353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:23.211025 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.211472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.211916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:23.226530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:23.345951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:23.353812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:23.355238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:23.357178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7762549e-4bda-4545-9f64-aeae583d303a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.158830 Sep 15 14:14:23.357920 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 331/632] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:23 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:23.619672 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:23.620312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:23.626822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.627305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.627768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:23.628457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.628912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.629340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:23.756404 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:23.764129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6212bf01-1a8d-4103-bb1c-723cacb0c095 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.148261 Sep 15 14:14:23.764699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 302/633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:23 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:23.934347 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:23.935035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:23.941371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.941850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.942276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:23.942955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:23.943405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:23.943864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:24.069250 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:24.077424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1550e25f-87e9-4d49-90ed-3c33fde30e7f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.146938 Sep 15 14:14:24.077987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 332/634] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:23 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:24.382482 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:24.383095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:24.390271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:24.390753 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:24.391184 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:24.391912 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:24.392365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:24.392787 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:24.531839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:24.540130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:24.541568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:24.542716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-571211d9-32eb-4a2c-81c7-d4c07e9df69c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.164148 Sep 15 14:14:24.543377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 303/635] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:24 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:24.788421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:24.789510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:24.799382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:24.800067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:24.800507 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:24.801687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:24.802119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:24.802713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:24.998138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:25.008415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a1b7044c-ecbc-46b7-b933-dbe9e704e337 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.225570 Sep 15 14:14:25.024623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 333/636] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:24 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:25.101513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:25.102127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:25.110263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:25.110679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:25.111114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:25.111850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:25.112305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:25.112756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:25.297303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:25.307169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-992dab83-cf89-4f4e-850d-b7eb19a00955 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1710 microversion: 2.1 time: 0.208675 Sep 15 14:14:25.307900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 304/637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:25 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1710 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:25.569265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:25.571270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:25.579604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:25.580726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:25.581170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:25.582088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:25.582546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:25.582978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:25.728053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:25.737685 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:25.739315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:25.740573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5951a634-c9b2-4527-a7f8-f62dd45d979c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.175328 Sep 15 14:14:25.741295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 334/638] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:25 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:26.034526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:26.035161 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:26.042237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.042875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.043323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.044608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.045067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.045488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.050797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:26.244206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:26.254979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-deb7fa34-f3e5-42f8-be65-ebb501fa97b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.225447 Sep 15 14:14:26.255925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 305/639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:26 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:26.332457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:26.333811 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:26.350582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.351093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.351590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.355979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.356479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.356952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.526650 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:26.536179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f372d442-4904-496f-9e26-51b6ed6fc6da tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1714 microversion: 2.1 time: 0.208118 Sep 15 14:14:26.536957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 335/640] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:26 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1714 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:26.771151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:26.773113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:26.798961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.801394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.802640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.803873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:26.804497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:26.805291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:26.981967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:26.990937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:26.992743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:26.994081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e528c7f3-6188-4758-95af-ca12d3adf53c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.230259 Sep 15 14:14:26.994867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 306/641] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:26 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:27.279862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:27.281036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:27.294372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:27.294715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:27.295073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:27.316701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:27.317336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:27.317792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:27.533643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:27.541329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7e4128cd-2f80-4da8-b232-bcbadc5a2cac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.266372 Sep 15 14:14:27.542108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 336/642] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:27 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:28.022436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:28.024245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:28.032789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:28.033433 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:28.034217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:28.035067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:28.035845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:28.036424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:28.188406 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:28.198034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:28.199482 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:28.200767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ab52897d-8415-49d5-80c4-5be4ee8701c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.183157 Sep 15 14:14:28.201334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 307/643] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:28 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:28.565926 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:28.567276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:28.573557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:28.574045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:28.574473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:28.575559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:28.576199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:28.576790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:28.728722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:28.737889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f8b3ae82-0fde-4e56-96a5-7a6eabd7d35f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.176142 Sep 15 14:14:28.738478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 337/644] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:28 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:29.226731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:29.227430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:29.235712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:29.236202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:29.236629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:29.237318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:29.237767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:29.240587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:29.396576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:29.406654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:29.408725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:29.410211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d2faea89-0658-4157-9b81-a7b0adf1e5b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.187756 Sep 15 14:14:29.410793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 308/645] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:29 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:29.764195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:29.765458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:29.773410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:29.773903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:29.774359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:29.775093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:29.775560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:29.776029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:29.929237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:29.938390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-878ba18e-d559-4fc8-89d7-544f8b84f086 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.178143 Sep 15 14:14:29.944236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 338/646] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:29 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:30.446375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:30.446894 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:30.453405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:30.454027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:30.454316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:30.455015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:30.455473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:30.455928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:30.600173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:30.610392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:30.611866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:30.613108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f532b8a1-f07e-444c-a4b1-a02b5080ae15 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.173109 Sep 15 14:14:30.613976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 309/647] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:30 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:30.961697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:30.962312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:30.969687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:30.970492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:30.970950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:30.971679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:30.972182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:30.972612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:31.111330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:31.120059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7e2fff4b-18c5-4e0b-bb36-f2e50e50a239 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.162193 Sep 15 14:14:31.121065 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 339/648] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:30 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:31.639810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:31.641068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:31.648296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:31.649032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:31.649647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:31.650515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:31.651140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:31.651570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:31.799633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:31.808363 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:31.810759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:31.811969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dc2447c1-ee44-488b-b2c7-90c8a1fa1787 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.176896 Sep 15 14:14:31.829677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 310/649] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:31 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:32.146400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:32.146941 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:32.155639 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:32.156870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:32.157300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:32.158032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:32.158491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:32.158915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:32.322934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:32.331976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-586f0529-22c0-48d0-8077-53cb193c0a59 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.189539 Sep 15 14:14:32.333355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 340/650] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:32 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:32.837822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:32.839036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:32.847392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:32.847911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:32.848533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:32.849241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:32.849693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:32.850117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:33.004656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:33.013399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:33.014890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:33.016089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f5125926-02b6-46fb-af0b-d82d74e9e9a3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.182521 Sep 15 14:14:33.019721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 311/651] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:32 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:33.355678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:33.356939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:33.363626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:33.364436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:33.365105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:33.366032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:33.366705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:33.367389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:33.558052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:33.567447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a944be7e-0873-48d5-ba9e-b061e3219b02 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.215586 Sep 15 14:14:33.579708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 341/652] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:33 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:34.044129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:34.045372 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:34.057859 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:34.058346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:34.058769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:34.063015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:34.064021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:34.064667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:34.207906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "name": "network-vif-plugged", "status": "completed", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:34.221322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:34.222166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:34.222954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:34.236655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] Creating event network-vif-plugged:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:14:34.238556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:34.244999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-698ea566-fa57-47c9-8f87-f362a08bf42f req-906dd9de-70d1-4d11-9538-02ccc0810752 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Sep 15 14:14:34.246139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 342/653] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:14:34.257744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:34.261047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:34.262232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b057ea7f-bfa9-4274-aca4-44e43e96e50d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.223522 Sep 15 14:14:34.263641 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 312/654] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:34 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:34.594240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:34.594939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:34.605812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:34.606333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:34.606773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:34.607487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:34.607988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:34.608417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:34.835173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:34.844204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-264b3aed-7978-4313-b643-42c5c06ea58d tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.254330 Sep 15 14:14:34.860635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 343/655] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:34 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:35.293548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:35.294409 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:35.305827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:35.306648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:35.307587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:35.310477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:35.311137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:35.311745 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:35.468191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:35.480856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:35.482879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:35.485149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-21eeff01-869d-41de-9187-254f16193232 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.195467 Sep 15 14:14:35.486242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 313/656] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:35 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:35.876027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:35.877312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:35.887664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:35.888669 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:35.889170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:35.890764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:35.891169 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:35.891936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:36.081813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:36.089844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e5ac9d4d-440f-4af7-8e9d-7245245ae8b2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.220914 Sep 15 14:14:36.090969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 344/657] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:35 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:14:36.515182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:36.515953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:36.522789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:36.523279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:36.523764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:36.524473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:36.524923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:36.525556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:36.683001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:36.693135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:36.694798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:36.696304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8f9654ca-9c4d-421b-b06c-c7a8a39be694 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.185760 Sep 15 14:14:36.696873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 314/658] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:36 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:37.120776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:37.121574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:37.131699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:37.132378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:37.133102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:37.133896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:37.134445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:37.134855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:37.291117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:37.301158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-763c20f2-6209-4f3f-9ed6-d0e5ed35d913 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.184827 Sep 15 14:14:37.316931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 345/659] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:37 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:37.725125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:37.725931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:37.734456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:37.734950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:37.735385 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:37.736299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:37.738724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:37.739486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:38.094387 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:38.107413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:38.109168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:38.110398 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c05ce804-6ec8-448c-b33c-01edd4745c22 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.391251 Sep 15 14:14:38.111735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 315/660] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:37 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:38.324527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:38.325685 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:38.332471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:38.332980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:38.333422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:38.334129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:38.334587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:38.335013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:38.552784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:38.562361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-804b64ce-d5e9-4bad-b1c6-5e8c99b05e9f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.241587 Sep 15 14:14:38.563774 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 346/661] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:38 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:39.136840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:39.137607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:39.140161 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=53 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:39.145715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:39.146271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:39.146772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:39.147527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:39.148087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:39.148580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:39.317179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:39.328390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:39.330150 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:39.331321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-38b63771-3dc6-4f57-82c6-1bfee053d9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.198460 Sep 15 14:14:39.332094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 316/662] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:39 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:39.585938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:39.587192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:39.594690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:39.595157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:39.595609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:39.596337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:39.597038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:39.597537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:39.739289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:39.747411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d7f52dac-c536-43fc-9f4e-54c321a2fcac tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.165282 Sep 15 14:14:39.748343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 347/663] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:39 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:40.357926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:40.358982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:40.364967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:40.365358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:40.365865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:40.366562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:40.366982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:40.367397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:40.499714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:40.507733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:40.509169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:40.510306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7d729253-e42e-441b-afbb-11e155df5574 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.156589 Sep 15 14:14:40.510864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 317/664] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:40 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:40.770470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:40.771097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:40.777353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:40.777876 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:40.778370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:40.779058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:40.779508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:40.779953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:40.909549 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:40.911845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=100 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:40.918533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a131da92-57b1-4b83-a7ea-4cdb82991c63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.151953 Sep 15 14:14:40.919108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 348/665] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:40 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:41.536435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:41.537037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:41.543371 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:41.544536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:41.544990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:41.545668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:41.546113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:41.546529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:41.677005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:41.686540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:41.688247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:41.689416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6baa040d-1be2-47a9-bcf7-30c8afc80422 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.156932 Sep 15 14:14:41.689976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 318/666] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:41 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:41.941220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:41.941755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:41.948003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:41.948494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:41.948931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:41.949619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:41.950301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:41.950726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:42.082166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:42.089711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1d9e4b7e-d3ef-42e1-8cf9-344017e770d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.152748 Sep 15 14:14:42.090266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 349/667] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:41 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:42.715075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:42.715675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:42.722462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:42.722941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:42.723373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:42.724096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:42.724552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:42.724972 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:42.849847 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:42.857874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:42.859308 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:42.860477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fc157a34-c85f-41d8-b71f-b2b7486f8064 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.149348 Sep 15 14:14:42.861035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 319/668] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:42 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:43.113580 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:43.114103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:43.120461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:43.120950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:43.121391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:43.122082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:43.122539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:43.122967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:43.251138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:43.258676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eb590d19-b9cd-4262-9062-5accb8229b74 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.148995 Sep 15 14:14:43.259242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 350/669] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:43 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:43.886212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:43.886830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:43.893939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:43.894655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:43.895099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:43.895836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:43.896294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:43.896723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:44.037755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:44.045864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:44.047676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:44.048898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de67a16d-1b35-4248-9dce-c6b5f457439e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.166771 Sep 15 14:14:44.049466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 320/670] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:43 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:44.281106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:44.281810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:44.288264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:44.288746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:44.289179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:44.289871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:44.290324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:44.290771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:44.424730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:44.432117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1572d5b8-a2fd-44b2-a330-1b5282792b87 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1358 microversion: 2.1 time: 0.155512 Sep 15 14:14:44.432679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 351/671] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:44 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:44.538979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "name": "network-vif-plugged", "status": "completed", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:44.548813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:44.549300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:44.549765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:44.560855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] Creating event network-vif-plugged:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:14:44.566320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-88a2eab1-e394-4d29-b427-5264eea07608 req-6a3e2fe4-eeb6-49d7-883b-8a5f9844dafe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Sep 15 14:14:44.567135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 321/672] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:45.075998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:45.076859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:45.086195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.086825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.087296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.088040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.088497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.088917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.256830 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.264914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.266860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.268048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-01d2e7c8-d487-4465-a95c-b65910a0164a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1742 microversion: 2.20 time: 0.196399 Sep 15 14:14:45.268608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 352/673] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:45 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:45.456856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:45.458080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:45.464196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.464673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.465101 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.465782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.466227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.466639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.486263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:45.694075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.705472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1fa41a91-f251-470d-8af6-3fb1402e4f94 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1549 microversion: 2.1 time: 0.252964 Sep 15 14:14:45.712021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 322/674] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:45 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:45.729160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:45.729766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:45.737689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.738177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.738632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.739326 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.739797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.740218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.886784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.896515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-067bde79-8831-49f9-a127-6abfdbf71665 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1549 microversion: 2.1 time: 0.171275 Sep 15 14:14:45.906426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 353/675] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:45 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:45.921838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:45.928565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:45.929688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Searching by: {'deleted': False, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046'} {{(pid=120648) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 14:14:45.938435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.939357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.940040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:45.941792 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:45.942589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:45.943460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:46.065134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.multi_cell_list [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120648) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 14:14:46.194734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6b4a32cb-03a2-41fb-8d60-720a90ff4c33 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.276401 Sep 15 14:14:46.202817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 323/676] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 15 14:14:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:46.209150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:46.209769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:46.217609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:46.218419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:46.218922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:46.220548 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:46.221387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:46.221907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:46.296549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:46.300583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:46.309787 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:46.310525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:46.311171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:46.312346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:46.313313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:46.313921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:46.414200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:46.441408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-db9d90c5-17a8-4b93-81f2-19b66053eb03 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1549 microversion: 2.1 time: 0.236929 Sep 15 14:14:46.457289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 354/677] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:46 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1549 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:46.506203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:46.520077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:46.523647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:46.524884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aa2903a2-24a1-439d-be83-7f8ceb65e389 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.233765 Sep 15 14:14:46.529468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 324/678] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:46 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:47.566316 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:47.574540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:47.578610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=66 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:47.600964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:47.601533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:47.601972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:47.602798 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:47.608647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:47.613079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:47.613336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:47.614415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:47.628936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:47.629926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:47.633170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:47.634882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:47.635569 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:47.636244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:47.843260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lazy-loading 'services' on Instance uuid 6db30a61-493d-42cb-803b-33969d3dcf22 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:14:47.864150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:47.877763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:47.879498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:47.881359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a0a82cee-0491-400f-9186-2c17b2f3a21b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.319545 Sep 15 14:14:47.882367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 355/679] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:47 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:48.057420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-47bfb2ea-bbc5-4098-94d4-682f4e0f8a47 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22/os-volume_attachments/d3959fdd-178d-41c8-b600-fa1d429faea5" status: 202 len: 0 microversion: 2.1 time: 0.448239 Sep 15 14:14:48.058155 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 325/680] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:14:47 2022] DELETE /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22/os-volume_attachments/d3959fdd-178d-41c8-b600-fa1d429faea5 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:14:48.526284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ef148e7-213b-440a-b39c-b3f970b8689f"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:48.529077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:48.536624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:48.537380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:48.538038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:48.538859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:48.539519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:48.540055 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:48.910772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:48.911380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:48.918403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:48.918887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:48.919322 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:48.920113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:48.920724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:48.921297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:49.075157 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:49.084875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:49.086306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:49.087464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bd08e524-b416-4362-8732-10d7e7a6bf35 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.181762 Sep 15 14:14:49.106471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 326/681] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:48 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:49.194645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6c836286-ad24-45de-ac04-a09e54e2810b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672371 Sep 15 14:14:49.200783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 356/682] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:14:48 2022] POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:14:50.113265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:50.113883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:50.120868 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.121381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.121797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.122496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.122950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.123371 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.286230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:50.297323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:50.308941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:50.311264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-596f7f0a-8f40-4dd7-8372-1df0beaffc9d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.202053 Sep 15 14:14:50.332562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 327/683] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:50 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:50.410200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:50.411721 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:50.418595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.419089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.419842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.420562 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.421026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.421517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.452950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:14:50.539494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b33807d4-ec9e-4467-8d7d-bf2846dc7a3f tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 204 len: 0 microversion: 2.1 time: 0.136086 Sep 15 14:14:50.540743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 357/684] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:14:50 2022] DELETE /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:14:50.549470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:50.550448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:50.564435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.565705 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.566313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.567032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:50.567481 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:50.567932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:50.720287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:50.729037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7a047bbc-e0f0-4dee-bfba-46b8fce1f3f3 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1513 microversion: 2.1 time: 0.183924 Sep 15 14:14:50.729620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 328/685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:50 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:51.346076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:51.346904 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:51.356186 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:51.357079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:51.357731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:51.358668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:51.359334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:51.360563 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:51.574939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:51.586513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:51.588938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:51.590304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bb10a64b-0104-430c-bf00-ad47ae312823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.249505 Sep 15 14:14:51.591042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 358/686] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:51 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:14:51.754572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:51.755222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:51.763665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:51.764606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:51.765362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:51.767642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:51.768300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:51.768898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:51.928317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:51.940817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-79ac7bf4-52fe-4b4f-917c-b3165cbf3066 tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1513 microversion: 2.1 time: 0.191818 Sep 15 14:14:51.942053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 329/687] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:51 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:52.622864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:52.623512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:52.633320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:52.634095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:52.634709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:52.635938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:52.636705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:52.637289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:52.794609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:52.804179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:52.806007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:52.807417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ec51e0aa-5545-4010-9c98-5b7341f301d2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.188753 Sep 15 14:14:52.808652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 359/688] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:52 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:52.966627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:52.967549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:52.975239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:52.975767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:52.976203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:52.977151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:52.977800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:52.978232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:53.189167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:53.199608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1594342-64c3-4cc8-abac-0a9008fcca2a tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1513 microversion: 2.1 time: 0.236398 Sep 15 14:14:53.200691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 330/689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:52 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:53.840765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:53.842085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:53.850633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:53.851496 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:53.852838 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:53.854594 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:53.855293 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:53.855919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:54.035419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:54.044725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:54.046404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:54.047958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b6991303-1638-417a-a7b9-c328ebf20e78 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.214047 Sep 15 14:14:54.048866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 360/690] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:53 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:54.148904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db30a61-493d-42cb-803b-33969d3dcf22", "name": "network-vif-deleted", "tag": "87d565fd-0b4a-4e2d-a010-7a5aad16a5c7"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:14:54.163237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:54.163784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:54.164307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:54.180416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] Creating event network-vif-deleted:87d565fd-0b4a-4e2d-a010-7a5aad16a5c7 for instance 6db30a61-493d-42cb-803b-33969d3dcf22 on hv-cinder-85697 Sep 15 14:14:54.197159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-b9359ea8-45a9-4045-9a46-ce79566b8475 req-30fdfc04-9628-4629-be1d-3314a2d664bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052222 Sep 15 14:14:54.197897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 331/691] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:14:54.222451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:54.223061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:54.233420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:54.233922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:54.234371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:54.235628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:54.236161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:54.236791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:54.378711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0877d583d4550b9ab14ee7f4394f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e90b31934484572bf7c7bdcbc0fdf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:54.386934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3da5a280-2348-4702-ad12-bfee6ebc199b tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 200 len: 1303 microversion: 2.1 time: 0.168250 Sep 15 14:14:54.387787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 361/692] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:54 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:14:55.079886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:55.084593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:55.095573 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:55.096389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:55.096887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:55.097587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:55.098201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:55.098618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:55.273095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:55.285250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:55.287341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:55.288836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-21cd0418-199c-42e5-9dd8-1e08fe5dbad8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.215365 Sep 15 14:14:55.289939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 332/693] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:55 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:55.425892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:55.426438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] [instance: 6db30a61-493d-42cb-803b-33969d3dcf22] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:55.432931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:55.433406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:55.434258 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:55.435624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:55.436102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:55.436708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:55.456578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] HTTP exception thrown: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Request method failure captured: Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 HTTP/1.1 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzKN7VEf_gtsUSHIBo5IQLICH-ovb_IT_n9Xk5ID-fRG-oMdvms-eAyNQK0q1JT7DvU2-YfO9mEe7m616jmZDh3CfPSMzB8rmunoItpx93VfJzQbVFlvfH0vYhgk_5VnRHLaQGyg644pq3J2kkpYjEywnmfw8pyShrbPJBzgE6Abdx4 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: 1e90b31934484572bf7c7bdcbc0fdf2d Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:14:55.459046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1e90b31934484572bf7c7bdcbc0fdf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1e90b31934484572bf7c7bdcbc0fdf2d"}]}] Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: 1e90b31934484572bf7c7bdcbc0fdf2d Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2143824419 Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-VolumesSnapshotTestJSON-2143824419-project Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 0ad0877d583d4550b9ab14ee7f4394f0 Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-VolumesSnapshotTestJSON-2143824419-project Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. Sep 15 14:14:55.460661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '6db30a61-493d-42cb-803b-33969d3dcf22'} Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:14:55.461547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. Sep 15 14:14:55.463019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:14:55.464950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] Returning 404 to user: Instance 6db30a61-493d-42cb-803b-33969d3dcf22 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:14:55.464950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-af7ae6f3-b945-4b9c-b0d3-747626a586cd tempest-VolumesSnapshotTestJSON-2143824419 tempest-VolumesSnapshotTestJSON-2143824419-project] 10.222.0.27 "GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22" status: 404 len: 111 microversion: 2.1 time: 0.053827 Sep 15 14:14:55.468958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 362/694] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:14:55 2022] GET /compute/v2.1/servers/6db30a61-493d-42cb-803b-33969d3dcf22 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:14:56.334876 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:56.335613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:56.337733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:56.346926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:56.347631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:56.348171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:56.349098 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:56.349711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:56.350296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:56.500209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:56.510583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:56.512223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:56.513807 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8a5e5d7b-f78e-488b-a9a7-0647aa4eea72 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.183141 Sep 15 14:14:56.514876 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 333/695] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:56 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:57.540380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:57.540980 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:57.547614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:57.548303 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:57.548734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:57.549410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:57.549859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:57.550277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:57.552885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:14:57.685135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:57.693762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:57.695187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:57.696349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8f29e853-83a1-4137-bca9-bb0afd847ea3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.159845 Sep 15 14:14:57.696901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 363/696] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:57 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:58.722204 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:58.722915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:58.730038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:58.730512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:58.730941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:58.731653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:58.732130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:58.732546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:58.862928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:58.871350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:58.872811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:14:58.873957 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a7e07b4a-9d62-4a26-8110-e49ffd1ac2c7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.156240 Sep 15 14:14:58.874516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 334/697] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:58 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:14:59.902931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:14:59.903530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:14:59.910417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:59.910901 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:59.911336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:14:59.912049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:14:59.912500 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:14:59.912922 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:00.051242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:00.060781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:00.062249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:00.064027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bd9b6abc-cf44-41fe-b04e-b5ec921900bb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.164495 Sep 15 14:15:00.064706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 364/698] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:14:59 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:01.090195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:01.090884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:01.097586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:01.098149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:01.098586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:01.099276 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:01.099756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:01.100178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:01.235376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:01.243420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:01.244875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:01.246011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7bcef142-6b06-4eaa-b1b0-707b17d75b3c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.159787 Sep 15 14:15:01.246564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 335/699] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:01 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:02.270903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:02.271511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:02.277970 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:02.278453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:02.278885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:02.279566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:02.280050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:02.280471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:02.415037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:02.424455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:02.426107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:02.427291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dac10bfb-1b79-4128-a353-fea6a591b97c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1737 microversion: 2.20 time: 0.160952 Sep 15 14:15:02.427898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 365/700] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:02 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:02.504362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "name": "network-vif-unplugged", "status": "completed", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:02.516746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:02.517420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:02.518357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:02.541246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] Creating event network-vif-unplugged:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:15:02.546706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-8484cbd7-af73-4398-84e0-c493cae1e72d req-ee0cb79b-cb5b-49e8-8a67-855cfbfd4aaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046608 Sep 15 14:15:02.547311 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 336/701] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:15:03.454053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:03.454854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:03.461584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:03.462061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:03.462491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:03.463190 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:03.463636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:03.464075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:03.608534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:03.617781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:03.619504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:03.621110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6d2e18bb-acc6-4e09-8921-771ffdc7a27a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1719 microversion: 2.20 time: 0.170884 Sep 15 14:15:03.622188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 366/702] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:03 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:04.432467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:04.433158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:04.440656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:04.441143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:04.441561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:04.442241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:04.442690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:04.443106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:04.572539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:04.580627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f08bb64-37a2-487d-b088-ec00b79297e4 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1595 microversion: 2.1 time: 0.152260 Sep 15 14:15:04.581188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 337/703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:15:04 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:15:04.649669 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:04.650466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:04.659473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:04.660339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:04.661001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:04.661803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:04.662377 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:04.663071 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:04.813127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:04.822931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:04.824390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:04.825874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0176e9f3-cd57-42a7-a642-c954441fcea5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1719 microversion: 2.20 time: 0.180322 Sep 15 14:15:04.826734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 367/704] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:04 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:05.852418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:05.853036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:05.859714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:05.860425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:05.861082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:05.861952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:05.862564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:05.863187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:06.070092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:06.085794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:06.088609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:06.090148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-969c29c8-ffff-430c-beb1-b881971231af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1719 microversion: 2.20 time: 0.241479 Sep 15 14:15:06.104207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 338/705] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:05 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:06.708355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:06.718170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:06.718745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:06.719243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:06.731419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] Creating event network-changed:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:15:06.737081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d168cda1-6442-431d-8321-35268ad43366 req-afc443dc-d347-4fb3-b4ee-c86e320c4412 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Sep 15 14:15:06.737678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 368/706] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:15:07.120545 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:07.121306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:07.128349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:07.129095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:07.129764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:07.130548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:07.131197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:07.131667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:07.152821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:07.417582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:07.443896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:07.448978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:07.451331 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3b5e616e-da24-4666-8088-e757adfb74f9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1662 microversion: 2.20 time: 0.335544 Sep 15 14:15:07.452780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 339/707] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:07 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1662 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:07.480419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec660fa0-6e9f-4519-8566-ffb8a3887f5f"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:07.483059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:07.490726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:07.491230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:07.491675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:07.492526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:07.492994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:07.493427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:07.937724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2cc3b392-06cc-4cb4-a090-64e180c852f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.461692 Sep 15 14:15:07.947712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 369/708] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 15 14:15:07 2022] POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments => generated 188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:15:08.115769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:08.116464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:08.122887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.127757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.128977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.129168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.129630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.130053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.143977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1424325707"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:08.144546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:08.151296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.151823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.152264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.153143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.153761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.154188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.293947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120648) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 14:15:08.296764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.network.security_group_api [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Adding security group f02c5e1e-ffb1-43e0-9848-33194254a727 to port 8b54bbd9-461c-4eb0-8b69-008918d44954 Sep 15 14:15:08.369757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-56a0d2b0-ea70-4851-9eb0-12f5e71951aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/action" status: 202 len: 0 microversion: 2.20 time: 0.258461 Sep 15 14:15:08.370584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 340/709] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 15 14:15:08 2022] POST /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 14:15:08.380796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:08.381354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:08.387279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.387798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.388234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.389362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.389362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.389790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.557676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:08.566955 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:08.568561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:08.569989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b3a8918d-432b-459a-b0ec-95ab7c796439 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1748 microversion: 2.20 time: 0.193693 Sep 15 14:15:08.571128 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 341/710] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:08 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1748 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:15:08.640167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6c1d1cad-e052-475c-ad9e-fe8dbab1bc6b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action" status: 202 len: 0 microversion: 2.1 time: 0.500885 Sep 15 14:15:08.640773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 370/711] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:15:08 2022] POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 14:15:08.649691 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:08.650301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:08.651250 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:08.661710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.662662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.663147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.663298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.663577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.663776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.665321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:08.670196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:08.670651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:08.675449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] Creating event network-changed:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:15:08.680749 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-780eca9e-37a0-445f-baa6-2c9d819c6db6 req-8ed4f357-541d-4821-ba56-11164d5d9c39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034086 Sep 15 14:15:08.681613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 371/712] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:15:08.824543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:08.833998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e32ffe94-4cad-4f64-90a6-f0d10dfda0a5 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1761 microversion: 2.1 time: 0.188302 Sep 15 14:15:08.834580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 342/713] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:15:08 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:15:09.597385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:09.597986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:09.604060 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:09.604540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:09.604976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:09.605658 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:09.606112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:09.606535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:09.736976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:09.745675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:09.747108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:09.748348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-10d998d6-ca9d-4290-ab4e-0de6ad3a34bf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1748 microversion: 2.20 time: 0.155735 Sep 15 14:15:09.748881 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 372/714] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:09 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:10.773817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:10.774447 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:10.776726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:10.781757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:10.782235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:10.782663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:10.783367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:10.783938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:10.784357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:10.918448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:10.927498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:10.928946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:10.930082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3537e68c-fa2c-4d20-9959-1d6ce8728f9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1748 microversion: 2.20 time: 0.160124 Sep 15 14:15:10.930666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 343/715] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:10 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:11.957353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:11.957981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:11.964353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:11.964837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:11.965277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:11.965963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:11.966419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:11.966843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:12.099085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:12.107886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:12.109336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:12.110493 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-54e414a0-40dc-4bb5-8865-7ed9964c23b4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1748 microversion: 2.20 time: 0.157285 Sep 15 14:15:12.111042 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 373/716] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:11 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:13.135856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:13.137050 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:13.144360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:13.145101 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:13.145530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:13.146228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:13.146839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:13.147251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:13.358749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:13.368596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:13.370072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:13.371459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-baac85c6-5d21-4676-8100-15ea6254ea0c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1750 microversion: 2.20 time: 0.239410 Sep 15 14:15:13.372053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 344/717] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:13 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1750 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:14.397833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:14.398447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:14.405667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:14.406145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:14.406581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:14.407396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:14.407977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:14.408421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:14.537765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:14.546113 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:14.547527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:14.548691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8d075e53-bdf5-4ab5-9550-f6588104dfdd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.155411 Sep 15 14:15:14.549878 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 374/718] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:14 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:15.576386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:15.577130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:15.584234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:15.584714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:15.585145 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:15.585841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:15.586297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:15.586715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:15.748338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:15.764429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:15.766940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:15.769747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-88f0bd8d-bccc-46f8-9e6f-46579727004a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.197032 Sep 15 14:15:15.771472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 345/719] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:15 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:16.797366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:16.797972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:16.804713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:16.805191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:16.805619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:16.806297 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:16.806743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:16.807160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:16.956089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:16.964578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:16.966003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:16.967142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0ac6994d-f4c6-4e6b-ab48-398824c6166c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.173649 Sep 15 14:15:16.967705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 375/720] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:16 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:17.994346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:17.994948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:18.001978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:18.002478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:18.003024 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:18.003750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:18.004254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:18.004674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:18.154811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:18.164461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:18.166313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:18.167659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f3ad915a-b3dc-4549-adf7-4735e1acd971 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.177186 Sep 15 14:15:18.168249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 346/721] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:17 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:19.195118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:19.195659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:19.198246 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:19.203307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:19.203822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:19.204412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:19.205783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:19.206555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:19.207072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:19.348263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:19.365157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:19.367908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:19.369799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c08be1f0-3adc-4165-a10d-0a599bc12442 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.178094 Sep 15 14:15:19.370517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 376/722] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:19 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:20.397070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:20.397675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:20.404544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:20.405027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:20.405456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:20.406165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:20.406616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:20.407046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:20.553261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:20.563056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:20.565755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:20.566934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dffd99ac-c38a-4fb0-9cf7-dae0ca6e1739 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.175062 Sep 15 14:15:20.567567 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 347/723] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:20 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:21.593595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:21.594248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:21.601160 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:21.601642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:21.602271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:21.602882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:21.603354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:21.607865 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:21.744442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:21.754842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:21.756312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:21.757472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-70d514da-9f15-4509-bf46-5ef07347149e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.167853 Sep 15 14:15:21.758077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 377/724] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:21 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:22.785095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:22.785733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:22.792512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:22.792994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:22.793427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:22.794230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:22.794578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:22.794996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:22.947287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:22.957853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:22.959268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:22.960454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-34c469fa-661f-4c03-948d-349618195758 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.180068 Sep 15 14:15:22.961012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 348/725] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:22 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:23.988729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:23.989420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:23.996442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:23.997046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:23.997732 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:23.998548 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:23.999436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:24.000120 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:24.187036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:24.190383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:24.198559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:24.200127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:24.201546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-757cafe6-d027-4e5f-93e3-5707a7113434 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.218742 Sep 15 14:15:24.202100 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 378/726] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:23 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:25.236690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:25.237412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:25.243759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:25.244241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:25.244674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:25.245359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:25.245818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:25.246235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:25.406255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:25.418552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:25.420923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:25.422686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d3565c41-0d48-4836-a13f-e04ab4a39bb9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.189862 Sep 15 14:15:25.423338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 349/727] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:25 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:26.449787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:26.450554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:26.459367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:26.460034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:26.460571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:26.461372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:26.461945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:26.462466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:26.605979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:26.624918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:26.626392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:26.627807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-93072734-7c5b-42c6-bb68-9b3c1257d2b6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.182776 Sep 15 14:15:26.628727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 379/728] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:26 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:27.653953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:27.654542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:27.661410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:27.661889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:27.662321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:27.663004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:27.663455 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:27.663909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:27.790734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:27.799249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:27.800695 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:27.801837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bf8ab2f3-0673-4edc-a1d7-4f3cad63ea1d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.151959 Sep 15 14:15:27.802395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 350/729] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:27 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:28.827527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:28.828154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:28.834930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:28.835406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:28.835876 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:28.836555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:28.837003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:28.837417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:28.964100 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:28.973360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:28.974784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:28.975960 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e35b5d33-d271-4a6e-86bc-b30dc1bc7aa3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.152303 Sep 15 14:15:28.976515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 380/730] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:28 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:30.001766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:30.002908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:30.009340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:30.009814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:30.010241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:30.010919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:30.011364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:30.011825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:30.148686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:30.157421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:30.159030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:30.160291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7cc1ef4d-9c23-4c43-8dea-1498a7d6d6ef tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.162318 Sep 15 14:15:30.160852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 351/731] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:29 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:31.185841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:31.186470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:31.193742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:31.194225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:31.194659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:31.195348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:31.195837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:31.196261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:31.331197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:31.339632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:31.341090 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:31.342237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9e750254-e41f-4086-a59e-1e78d423c51f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.160386 Sep 15 14:15:31.342800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 381/732] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:31 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:15:32.373177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:32.373843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:32.384881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:32.385396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:32.385843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:32.390821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:32.391364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:32.391804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:32.549261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:32.557853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:32.559279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:32.560500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aa80a86a-6323-49a7-b3c1-76fce44fddfa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.193810 Sep 15 14:15:32.561064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 352/733] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:32 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:33.590457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:33.591062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:33.597962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:33.598450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:33.598883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:33.599568 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:33.600058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:33.600483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:33.728370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:33.737659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:33.739102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:33.740289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-56d27099-93ad-4675-b1c2-8638012fbb71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.153829 Sep 15 14:15:33.740846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 382/734] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:33 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:34.765800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:34.766428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:34.773119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:34.773592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:34.774012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:34.774685 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:34.775129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:34.775540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:34.905710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:34.914635 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:34.916083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:34.917269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ac5059a2-9256-4a3a-aaa4-62d159e57af6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.155286 Sep 15 14:15:34.917830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 353/735] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:34 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:35.943489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:35.944125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:35.950526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:35.950955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:35.951392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:35.952114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:35.952572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:35.952998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:36.078490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:36.086903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:36.088365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:36.089499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a0bc9ba0-728a-4404-99ef-935d22f3a905 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.150716 Sep 15 14:15:36.090063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 383/736] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:35 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:37.115652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:37.116280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:37.122223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:37.122702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:37.123135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:37.123852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:37.124306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:37.124724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:37.254272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:37.256482 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:37.264472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:37.265891 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:37.267038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9fe91172-caf5-4fb1-9846-775366e43410 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.156119 Sep 15 14:15:37.267602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 354/737] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:37 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:38.292932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:38.293556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:38.300750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:38.301488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:38.301931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:38.302627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:38.303084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:38.303511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:38.434206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:38.443948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:38.445416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:38.446571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e9e19c81-cef5-470f-a40a-aa7a1e0bc351 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.157526 Sep 15 14:15:38.447129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 384/738] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:38 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:39.472730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:39.473373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:39.480910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:39.481418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:39.481845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:39.482574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:39.483049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:39.483487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:39.613996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:39.622373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:39.623813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:39.624937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-505c886d-9f80-4d71-b609-59b336eabce8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.156703 Sep 15 14:15:39.625492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 355/739] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:39 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:40.649313 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:40.655001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:40.661914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:40.662407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:40.662840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:40.663537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:40.664010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:40.664652 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:40.795221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:40.804189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:40.805609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:40.806749 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5198ad62-3a6a-42a4-bab2-88d29ff28cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.161395 Sep 15 14:15:40.807307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 385/740] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:40 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:41.832926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:41.833522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:41.835881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=26 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:41.840954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:41.841431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:41.841848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:41.842533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:41.842976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:41.843393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:41.974472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:41.983064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:41.984513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:41.985688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0fcbe5d6-f74a-4431-a9dd-4ece7f04038b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.156720 Sep 15 14:15:41.986253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 356/741] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:41 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:43.011712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:43.012326 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:43.018298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:43.018824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:43.019575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:43.020298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:43.020737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:43.021156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:43.152187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:43.161229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:43.162665 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:43.163867 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-238fdd99-8045-4629-b14e-ddd114992359 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.156158 Sep 15 14:15:43.164435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 386/742] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:43 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:44.191190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:44.191927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:44.198374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:44.198852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:44.199283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:44.200001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:44.200452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:44.200870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:44.330138 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:44.338563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:44.340015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:44.341152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f323b5d0-d400-4fc9-905c-4fb393aebb33 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.154805 Sep 15 14:15:44.341706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 357/743] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:44 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:45.366247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:45.366864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:45.373213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:45.373690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:45.374115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:45.374793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:45.375236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:45.375651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:45.501679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:45.510961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:45.512462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:45.513604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d8c08a99-44ea-4a18-b743-02a6a1ed605e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.151232 Sep 15 14:15:45.514159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 387/744] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:45 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:46.539211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:46.539933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:46.546211 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:46.546687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:46.547112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:46.547816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:46.548263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:46.548679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:46.681877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:46.690508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:46.692526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:46.693657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d4566d2-fb1e-47a1-b2e8-0fa0a4ab6405 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.158540 Sep 15 14:15:46.694206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 358/745] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:46 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:47.718906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:47.719507 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:47.726320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:47.727036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:47.727480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:47.728187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:47.728635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:47.729051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:47.870101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:47.880397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:47.882330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:47.883487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7a9c34df-1b39-4fca-9e36-86aa15a92d71 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.168396 Sep 15 14:15:47.884056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 388/746] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:47 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:48.909466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:48.909988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:48.917143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:48.917619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:48.918048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:48.918729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:48.919181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:48.919596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:49.065602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:49.075523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:49.077257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:49.078495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-025a4ad5-7986-40e6-946d-2c8fffa9fb1e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.173157 Sep 15 14:15:49.079066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 359/747] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:48 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:50.105330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:50.105853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:50.108437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=26 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:15:50.114140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:50.114683 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:50.115132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:50.115881 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:50.116378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:50.116823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:50.250059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:50.259123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:50.260576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:50.261709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a948808b-0869-4ea7-9548-f86f197ae656 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.160378 Sep 15 14:15:50.262254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 389/748] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:50 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:50.751297 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "name": "network-vif-plugged", "status": "completed", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:15:50.760969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:50.761436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:50.761859 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:50.773155 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] Creating event network-vif-plugged:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:15:50.778067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-9f94b94b-ae6d-49ce-9859-c809d71cfd0a req-d81ca9e8-3ffa-4b31-8acc-6fdbc36a81e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148703 Sep 15 14:15:50.778637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 360/749] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:15:51.287274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:51.287903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:51.294284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:51.294766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:51.295205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:51.295928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:51.296383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:51.296810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:51.431281 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:51.440119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:51.441563 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:51.442744 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ca678ee7-c8d0-47f0-b022-7ecbd411372d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.159527 Sep 15 14:15:51.443526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 390/750] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:51 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:52.469774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:52.470468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:52.477678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:52.478172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:52.478608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:52.479311 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:52.479804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:52.480939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:52.660132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:52.671135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:52.672963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:52.674312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e1510b98-7b8c-4c74-a9af-af23d48a6b9f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.209278 Sep 15 14:15:52.674971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 361/751] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:52 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:53.701889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:53.702418 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:53.709598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:53.710064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:53.710501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:53.711191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:53.711643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:53.712110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:53.841199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:53.850450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:53.851906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:53.853056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-55978d1a-fec7-48d5-8e2c-d265d3288881 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1806 microversion: 2.20 time: 0.155251 Sep 15 14:15:53.853615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 391/752] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:53 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:15:54.878304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:15:54.878815 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:15:54.886135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:54.886606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:54.887030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:54.887717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:15:54.888162 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:15:54.888575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:15:55.014570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:55.024022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:55.025432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:15:55.026565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7f26472b-5eef-4706-b541-04674cceaf55 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1793 microversion: 2.20 time: 0.152176 Sep 15 14:15:55.027127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 362/753] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:15:54 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1793 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:16:13.027341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=5 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:13.028088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=79 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:13.188309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "303d9fcc-e796-407d-bc03-6261c921bb80"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:13.191010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:13.196972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:13.197452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:13.197889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:13.198573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:13.199026 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:13.199449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:13.460256 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e7b2e348-c673-4459-88ab-ba2373198f90 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437388 Sep 15 14:16:13.460877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 392/754] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:16:13 2022] POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:16:18.252677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=13 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:18.253416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=45 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:18.371078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:18.371609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:18.377502 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:18.377985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:18.378420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:18.379107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:18.379564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:18.380021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:18.459808 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lazy-loading 'services' on Instance uuid 7417b73e-2234-4215-95ab-040a71f66d6b {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:16:18.531040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4efe2188-df4a-4ff5-b0c9-7a24090024df tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments/a9141d3e-167a-4008-8685-ab88421560de" status: 202 len: 0 microversion: 2.1 time: 0.283118 Sep 15 14:16:18.531658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 363/755] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:16:18 2022] DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments/a9141d3e-167a-4008-8685-ab88421560de => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:16:21.001005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:21.003269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:21.009727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.010213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.010667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.011528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.012022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.012445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.038391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'flavor' on Instance uuid fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:16:21.165244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8dbe762b-6286-4591-bd24-53ac9fa6fcef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/action" status: 200 len: 32 microversion: 2.1 time: 0.168974 Sep 15 14:16:21.165768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 393/756] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:16:20 2022] POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:16:21.176421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:21.177722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:21.184587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.185173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.185538 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.186326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.186892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.187319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.405116 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:21.414039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-476d1f47-97c5-47a4-9673-a8b1c537edaa tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.242261 Sep 15 14:16:21.414625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 364/757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:21 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:21.770369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:21.776506 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.776999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.777435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.800717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Going to try to stop instance {{(pid=120647) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 14:16:21.845362 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9f508c91-6960-4799-9f81-0ff06ce5a5f8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.079612 Sep 15 14:16:21.845972 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 394/758] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:16:21 2022] POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:16:21.854911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:21.855521 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:21.862280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.862903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.863341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.864202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:21.865286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:21.865877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:21.993076 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:22.000729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e455d478-de9a-4a3c-af31-ab45bec06e61 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.149784 Sep 15 14:16:22.001330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 365/759] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:21 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:22.439307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:22.440028 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:22.446528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:22.447004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:22.447432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:22.448139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:22.448587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:22.449002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:22.581490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:22.590924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a335033e-28d7-4e03-bc68-b5c89d51e64d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.156245 Sep 15 14:16:22.591492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 395/760] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:22 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:23.025821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:23.026433 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:23.032827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:23.033307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:23.033738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:23.034417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:23.034900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:23.035317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:23.163826 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:23.171443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cab3b783-7f6c-4b41-88d4-7c076bd12acd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.149441 Sep 15 14:16:23.172040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 366/761] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:23 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:23.613642 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:23.614252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:23.621472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:23.621958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:23.622396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:23.623083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:23.623534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:23.623984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:23.750257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:23.758462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c333a026-a4e3-40b1-8d57-066c30dc68c9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.148625 Sep 15 14:16:23.759066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 396/762] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:23 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:16:24.195487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:24.196119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:24.202444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:24.202918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:24.203345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:24.204051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:24.204496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:24.204909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:24.334762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:24.342359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b501f8a6-a568-430a-9385-e4413e348205 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.151754 Sep 15 14:16:24.342927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 367/763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:24 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:24.784163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:24.784764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:24.791772 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:24.792254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:24.792684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:24.793361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:24.793806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:24.794224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:24.921891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:24.930202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-30cb1649-a29a-4653-8653-a27161ff9c62 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.149843 Sep 15 14:16:24.930705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 397/764] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:24 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:25.366566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:25.367176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:25.373550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:25.374032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:25.374464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:25.375151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:25.375603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:25.376048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:25.504262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:25.512514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-933cf2e6-9242-4c36-8a8e-1870702265ec tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.150323 Sep 15 14:16:25.513082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 368/765] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:25 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:25.953784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:25.954388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:25.960711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:25.961198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:25.961633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:25.962318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:25.962768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:25.963191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:26.098820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:26.107598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dd47a5a5-24e2-4464-bb8c-3c6ff0322018 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.157670 Sep 15 14:16:26.108191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 398/766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:25 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:26.536053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:26.537294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:26.543766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:26.544481 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:26.544770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:26.545662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:26.546124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:26.546548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:26.682467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:26.690066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5413a699-e31d-4246-a85c-9a5e501427a5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.157895 Sep 15 14:16:26.690923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 369/767] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:26 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:27.131478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:27.132105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:27.138335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:27.138807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:27.139233 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:27.139944 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:27.140392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:27.140810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:27.267526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:27.276330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-54602a98-0a37-47c4-b75c-8095f83fb263 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.149379 Sep 15 14:16:27.276934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 399/768] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:27 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:27.714141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:27.714752 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:27.721111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:27.721593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:27.722029 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:27.722721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:27.723175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:27.723606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:27.848440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:27.856696 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e0417529-a260-4902-8ddd-95d5fa937268 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.146518 Sep 15 14:16:27.857262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 370/769] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:27 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:28.298988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:28.299598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:28.306882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:28.307366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:28.307835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:28.308528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:28.308984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:28.309405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:28.445686 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:28.455179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ab326e21-db29-4ab9-b556-3ae92b1a5b2b tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.160020 Sep 15 14:16:28.455762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 400/770] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:28 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:28.879782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:28.880616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:28.887127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:28.887612 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:28.888082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:28.888770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:28.889225 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:28.889649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:29.020971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:29.028608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-27f1ba6e-ed2c-4f1a-8570-b458fc34b065 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.152757 Sep 15 14:16:29.029178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 371/771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:28 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:29.478555 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:29.479159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:29.485470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:29.485947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:29.486379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:29.487058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:29.487509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:29.487965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:29.614991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:29.622975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c850fdc8-d909-4cc0-96c3-e4c4da5ca1cb tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.148898 Sep 15 14:16:29.623535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 401/772] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:29 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:30.052664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:30.053275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:30.059740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:30.060231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:30.060664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:30.061353 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:30.061804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:30.062224 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:30.189207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:30.197556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-27b19e37-a559-4333-b950-ded13a549170 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.148876 Sep 15 14:16:30.198149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 372/773] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:30 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:30.645737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:30.646556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:30.653987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:30.654850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:30.655651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:30.658086 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:30.658880 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:30.659467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:30.789625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:30.798083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d7f85146-1136-4fd6-b3d8-b9a71df7218f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.156356 Sep 15 14:16:30.798666 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 402/774] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:30 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:31.220560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:31.221186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:31.227767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:31.228267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:31.228759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:31.229468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:31.229922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:31.230343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:31.360185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:31.368356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b2c6c308-2049-49bb-89c5-d06446646674 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.151675 Sep 15 14:16:31.368931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 373/775] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:31 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:31.821190 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:31.821800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:31.828225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:31.828708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:31.829148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:31.829833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:31.830287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:31.830712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:31.963451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:31.972004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1ce11dc5-b3cd-4fc7-9534-8d1b34c333b1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.155022 Sep 15 14:16:31.972844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 403/776] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:31 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:32.391004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:32.392627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:32.399762 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:32.400314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:32.400748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:32.401553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:32.402027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:32.402425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:32.540926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:32.548907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-339124c1-59ef-433c-a0f3-d9f610bf4580 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1678 microversion: 2.1 time: 0.161809 Sep 15 14:16:32.549478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 374/777] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:32 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:32.996174 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:32.996777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:33.003058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.003531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.003998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.004671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.005674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.006162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.010402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:33.137574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:33.146965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-072d34fe-e02c-4c06-b2bb-efec70139385 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.153843 Sep 15 14:16:33.147761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 404/778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:32 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:33.573545 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:33.574092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:33.580496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.580977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.581444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.582133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.582583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.583007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.709488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:33.717362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ee7c4696-73c8-4d39-94ba-4d5502f15699 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1655 microversion: 2.1 time: 0.147744 Sep 15 14:16:33.717925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 375/779] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:33 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:16:33.740334 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:33.746410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.746899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.747338 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.769153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Going to try to start instance {{(pid=120647) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 14:16:33.809537 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-40ee6238-d383-4f47-91de-17b3ad93ea44 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.073032 Sep 15 14:16:33.810129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 405/780] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:16:33 2022] POST /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:16:33.819107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:33.819748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:33.825696 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.826121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.826553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.827233 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:33.827713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:33.828124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:33.955334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:33.963607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f521f1c-4692-4175-914e-e1e0d2ac49cd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1664 microversion: 2.1 time: 0.149099 Sep 15 14:16:33.964208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 376/781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:33 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:34.172077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:34.172844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:34.181214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:34.181706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:34.182178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:34.182887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:34.183343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:34.183798 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:34.322624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:34.334220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4c77ee8b-d0c6-4be1-b61f-bb48d13fe46d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.167455 Sep 15 14:16:34.344712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 406/782] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:34 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:34.986541 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:34.987164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:34.994419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:34.994909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:34.995341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:34.996065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:34.996535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:34.996942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:35.218330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:35.226500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-00431cc8-1900-4579-98cf-2724cffe60af tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1664 microversion: 2.1 time: 0.243882 Sep 15 14:16:35.227067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 377/783] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:34 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1664 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:35.358220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:35.358834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:35.365945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:35.366431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:35.366868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:35.367559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:35.368045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:35.368470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:35.499869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:35.508737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5add09e4-1aff-49e0-91e1-d3e4c933edae tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1735 microversion: 2.1 time: 0.154306 Sep 15 14:16:35.509323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 407/784] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:35 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:36.251937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:36.252953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:36.259626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.260132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.260562 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.261247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.261693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.262111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.393890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:36.397814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:36.403011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-355fe3b5-dddd-4fe6-984c-5f43936d387c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1664 microversion: 2.1 time: 0.155270 Sep 15 14:16:36.403580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 378/785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:36 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:36.532789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:36.533515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:36.541102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.541585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.542014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.542731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.543178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.543622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.685045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:36.695022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8393566d-2ee8-414b-bf42-e259043f37a2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1715 microversion: 2.1 time: 0.166192 Sep 15 14:16:36.695590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 408/786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:36 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:36.757976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:36.758467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:36.765505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.765988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.766451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.767129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.767577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.768019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.849929 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] HTTP exception thrown: Cannot 'detach_volume' instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 while it is in vm_state rescued Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Request method failure captured: Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments/303d9fcc-e796-407d-bc03-6261c921bb80 HTTP/1.1 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIzMGQvybpYHXpUl0WfjKIaM7DDV6NGuHx57yeWD7RgT527KG2NTita9SIHh18fKz1r5xLTtE5dfZCoCRICUszao2ziKZfU13K9oyt4WPOQW9e0xw4-G42Isz-ipC6_d3srTZT84lwujN_2QTqZT4HsejBHWO_pLAdDI4DAZqrl2fc Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:16:36.851553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fab43b244e854c0296530db48bc1b975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fab43b244e854c0296530db48bc1b975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}] Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 530e6587b39b4f4c98d7414b81453628 Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:16:36.853253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Cannot 'detach_volume' instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 while it is in vm_state rescued Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'server_id': 'fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8', 'id': '303d9fcc-e796-407d-bc03-6261c921bb80'} Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:16:36.854094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 while it is in vm_state rescued Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 while it is in vm_state rescued Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:16:36.855750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Returning 409 to user: Cannot 'detach_volume' instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 while it is in vm_state rescued {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:16:36.856973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6b9dc1fa-ed5f-4540-bab2-23eacfa35998 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments/303d9fcc-e796-407d-bc03-6261c921bb80" status: 409 len: 152 microversion: 2.1 time: 0.099529 Sep 15 14:16:36.856973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 379/787] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:16:36 2022] DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments/303d9fcc-e796-407d-bc03-6261c921bb80 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 14:16:36.866066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:36.866600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:36.872557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.873040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.873502 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.874216 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.874668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.875087 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.943502 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ec4cc9da-e55d-4fd1-a248-7426252f8870 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/action" status: 202 len: 0 microversion: 2.1 time: 0.081082 Sep 15 14:16:36.944166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 409/788] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:16:36 2022] POST /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:16:36.952393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:36.952988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:36.959106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.959598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.960082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:36.960771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:36.961232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:36.961654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:37.088724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:37.099426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-71d3b5ce-2c39-4b4e-9351-ffc3ee1e05ef tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1723 microversion: 2.1 time: 0.150514 Sep 15 14:16:37.100049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 380/789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:36 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:37.427346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:37.428323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:37.434365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:37.434851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:37.435287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:37.436014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:37.436471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:37.436895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:37.546229 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:16:37.546931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Thu Sep 15 14:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b (ip 10.222.0.27) !!! Sep 15 14:16:37.568141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:37.575781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-384ab17e-b416-44c6-9af5-2faa33f14807 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1668 microversion: 2.1 time: 0.153194 Sep 15 14:16:37.576348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 410/790] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:37 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:38.123408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:38.124034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:38.131250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:38.131761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:38.132203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:38.132899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:38.133382 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:38.133801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:38.267963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:38.276927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6e09d10d-5281-4611-a17a-eeab77b5de71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1723 microversion: 2.1 time: 0.157407 Sep 15 14:16:38.277491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 381/791] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:38 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:39.299954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:39.300589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:39.307094 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:39.307575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:39.308045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:39.308730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:39.309208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:39.309636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:39.650631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:39.658671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9469d4e6-da5a-497c-acd3-de3bb64ab255 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1723 microversion: 2.1 time: 0.362611 Sep 15 14:16:39.659257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 411/792] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:39 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:40.681516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:40.681961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:40.684274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:16:40.684405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 (ip 10.222.0.27) !!! Sep 15 14:16:40.690785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.691528 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.691989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.693188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.693802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.694221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.826754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:40.835135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0e4afd4b-02d4-4495-9ae8-088e9b2a37c7 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1729 microversion: 2.1 time: 0.157678 Sep 15 14:16:40.835722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 382/793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:40 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:40.857619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:40.858262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:40.865444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.865991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.866437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.866634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:40.867131 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.867586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.868035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.868995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:40.874843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.875324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.875783 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.876486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.876941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.877360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.946450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b2290522-2f61-4bce-a407-acaa2a3a934f tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092757 Sep 15 14:16:40.947089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 412/794] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:16:40 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:16:40.951409 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f686d031-4403-44aa-b40d-29148bfc9799 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action" status: 202 len: 0 microversion: 2.1 time: 0.088975 Sep 15 14:16:40.954813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 383/795] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:16:40 2022] POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 14:16:40.960484 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:40.961101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:40.966968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.967470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.967938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:40.968674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:40.969101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:40.969530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:41.224438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:41.232857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-586ff5af-e598-462b-8ebb-b50f3b50b5c9 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1753 microversion: 2.1 time: 0.276772 Sep 15 14:16:41.233438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 413/796] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:40 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1753 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:41.994236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:42.006030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:42.006712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:42.007349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:42.020301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] Creating event network-changed:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:16:42.026619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-5929f28a-35a2-408f-8f93-38b510ceb344 req-81c3c2aa-153e-4f28-9bc2-029dc5d7551f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099307 Sep 15 14:16:42.027227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 384/797] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:16:42.258013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:42.258816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:42.266823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:42.267315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:42.267778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:42.268487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:42.269083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:42.269517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:42.423499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:42.433210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-20828780-e266-456a-be5a-1c71aa40e65f tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.179809 Sep 15 14:16:42.434350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 414/798] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:42 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:43.458124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:43.458883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:43.465418 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:43.465896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:43.466321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:43.466998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:43.467443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:43.467888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:43.615187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:43.623441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b0b124e0-7112-4e97-8625-932a1bf9d4a1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.169473 Sep 15 14:16:43.624037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 385/799] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:43 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:44.041455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:16:44.047416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=47 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:44.053676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:44.054147 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:44.054574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:44.065000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] Creating event network-changed:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:16:44.070886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-dc5cb4db-77f0-49e7-883c-566f5beb4a10 req-da21529f-52ac-496c-af64-2a32daef956f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Sep 15 14:16:44.071542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 415/800] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:16:44.649025 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:44.649708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:44.657423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:44.657994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:44.658425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:44.659107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:44.659548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:44.660001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:44.801105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:44.809401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-25ac8ee4-b49e-44fb-bc37-507fb4914fc7 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.165148 Sep 15 14:16:44.809979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 386/801] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:44 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:45.834197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:45.834885 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:45.841020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:45.841503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:45.841943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:45.842629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:45.843091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:45.843513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:45.988152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:45.996524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bdc35057-13fe-4eb8-b405-9b1a8db90a52 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.167182 Sep 15 14:16:45.997091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 416/802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:45 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:47.020035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:47.021179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:47.027651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:47.028160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:47.028592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:47.029279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:47.029734 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:47.030157 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:47.173774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:47.182053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7af98c6b-d059-45a0-9446-868991a765ff tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.165855 Sep 15 14:16:47.182629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 387/803] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:47 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:48.205342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:48.205951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:48.213189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:48.213703 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:48.214136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:48.214826 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:48.215275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:48.215710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:48.362413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:48.371508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e40e932b-7806-4d13-9a6a-503106f77229 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.170017 Sep 15 14:16:48.372106 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 417/804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:48 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:49.395156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:49.395850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:49.398506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=51 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:49.403776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:49.404260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:49.404694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:49.405388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:49.405872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:49.406295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:49.547274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:49.555377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4a82c734-5fe0-44d8-8285-520c8a78526c tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.164100 Sep 15 14:16:49.555978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 388/805] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:49 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:50.579968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:50.580574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:50.587819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:50.588298 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:50.588730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:50.589420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:50.589872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:50.590296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:50.735494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:50.743627 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8aed8503-1608-45bd-8fd1-95bb1a020892 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.167527 Sep 15 14:16:50.744223 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 418/806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:50 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:51.767848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:51.768454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:51.775650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:51.776158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:51.776583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:51.777258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:51.777701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:51.778111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:51.922724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:51.931234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6079b0a7-177c-43e7-bad9-197b08619d63 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.167904 Sep 15 14:16:51.931824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 389/807] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:51 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:53.012201 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:53.012864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:53.019212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:53.019709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:53.020162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:53.021466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:53.021918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:53.022347 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:53.163192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:53.166896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:53.172109 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-593505b5-6e78-46b3-9c7f-9941ac2ef1c2 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.163791 Sep 15 14:16:53.172695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 419/808] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:53 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:54.195068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:54.195671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:54.202142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.202618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.203047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.203749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.204200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.204619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.346113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:54.354351 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1504f4f7-8b0d-4fda-a2c2-bca198633b01 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.163928 Sep 15 14:16:54.354954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 390/809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:54 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:54.399288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:54.399844 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:54.407561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.408076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.408525 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.409221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.409676 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.410105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.439302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bb73c82f-8bd4-47ef-ace9-2fd995b887fb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments/ec660fa0-6e9f-4519-8566-ffb8a3887f5f" status: 200 len: 194 microversion: 2.20 time: 0.044586 Sep 15 14:16:54.439913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 420/810] 10.222.0.27 () {60 vars in 1454 bytes} [Thu Sep 15 14:16:54 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments/ec660fa0-6e9f-4519-8566-ffb8a3887f5f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:16:54.509419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:54.509932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:54.515823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.516300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.516730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.517411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.517867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.518287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.599600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lazy-loading 'services' on Instance uuid 66c972aa-5fee-4e35-a30f-dd5e48f7d108 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:16:54.669841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-59fef559-1b10-4597-8425-5595f3875745 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments/ec660fa0-6e9f-4519-8566-ffb8a3887f5f" status: 202 len: 0 microversion: 2.20 time: 0.164875 Sep 15 14:16:54.670424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 391/811] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 15 14:16:54 2022] DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments/ec660fa0-6e9f-4519-8566-ffb8a3887f5f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:16:54.679710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:54.682354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:54.688481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.689242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.689865 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.690260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:54.690757 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:54.691450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:54.721585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fc9b3135-af49-4007-9c29-c8537da2b9f5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046578 Sep 15 14:16:54.722150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 421/812] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 15 14:16:54 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:16:55.378220 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:55.378920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:55.385085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:55.385567 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:55.386000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:55.386688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:55.387140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:55.387564 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:55.539953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:55.548329 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2023a6eb-0a16-4575-bbbf-bce9258276f0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.174783 Sep 15 14:16:55.548887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 392/813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:55 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:55.734697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:55.736840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:55.744305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:55.744789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:55.745221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:55.745947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:55.746390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:55.746805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:55.776935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-941b7013-6e53-4442-8273-c4ec5fd1b939 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046303 Sep 15 14:16:55.777690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 422/814] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 15 14:16:55 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:16:56.573144 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:56.573687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:56.579990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.580468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.580924 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.581600 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.582048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.582462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.722835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:56.731266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7eeda803-adba-4981-863c-a3fcc7ee7352 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.162071 Sep 15 14:16:56.731854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 393/815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:56 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:56.789666 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:56.791812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:56.798085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.798565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.799000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.799706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.800158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.800582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.829963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ae8dfe6d-79ec-410d-95de-a62aee7fc8e1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044361 Sep 15 14:16:56.830441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 423/816] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 15 14:16:56 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:56.894467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:56.894961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:56.901611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.902091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.902522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.903207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:56.903659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:56.904137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:56.923099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:16:56.930319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:16:57.006320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f6b8b8e7-47e4-4e03-ada6-20980fea65c8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 204 len: 0 microversion: 2.20 time: 0.115430 Sep 15 14:16:57.006910 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 394/817] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 15 14:16:56 2022] DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 14:16:57.017119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:57.017734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:57.024135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:57.024653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:57.025085 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:57.025778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:57.026236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:57.026661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:57.159204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:57.167414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:57.168871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:57.170037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f9b23033-96a2-4b7b-a7a5-3b6edd38b0ab tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.158579 Sep 15 14:16:57.170601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 424/818] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:16:57 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:16:57.755492 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:57.756380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:57.762724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:57.763216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:57.763651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:57.764375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:57.764828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:57.765251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:57.908310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:57.916663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-271434e0-0aae-4a69-b2e1-d0361c82abcc tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.165997 Sep 15 14:16:57.917235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 395/819] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:57 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:58.196483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:58.197014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:58.203322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:58.203839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:58.204272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:58.204951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:58.205397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:58.205814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:58.334062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:58.342213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:58.343640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:58.344801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e99640d4-efb6-4934-8b61-c0bc137069e5 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.153323 Sep 15 14:16:58.345436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 425/820] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:16:58 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:16:58.940930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:58.942916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:58.952796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:58.953599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:58.954320 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:58.955486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:58.956277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:58.956969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:59.119083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:59.127490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80b7faf9-c039-4182-90cc-3fadc7278b64 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1758 microversion: 2.1 time: 0.191945 Sep 15 14:16:59.128112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 396/821] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:16:58 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:16:59.371187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:16:59.371866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:16:59.378586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:59.379072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:59.379513 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:59.381007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:16:59.381460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:16:59.381928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:16:59.520202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:59.528453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:59.529896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:16:59.531045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-14a4f8bc-0b81-443f-9a64-90398ee5ae44 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.163829 Sep 15 14:16:59.531604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 426/822] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:16:59 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:00.154516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:00.155097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:00.161462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:00.162079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:00.162515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:00.163316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:00.163792 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:00.164212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:00.469341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:00.477448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c431e5f0-967f-4217-8156-db0e062ec0cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1761 microversion: 2.1 time: 0.326941 Sep 15 14:17:00.478028 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 397/823] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:00 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1761 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:00.557476 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:00.558204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:00.564965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:00.565461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:00.565895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:00.566859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:00.567636 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:00.568389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:00.713616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:00.722430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:00.724573 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:00.725815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c1dd805c-7563-4515-8823-7e4f7e9d1601 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1721 microversion: 2.20 time: 0.172311 Sep 15 14:17:00.726450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 427/824] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:00 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:17:01.166328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c972aa-5fee-4e35-a30f-dd5e48f7d108", "name": "network-vif-deleted", "tag": "4a259232-6560-4e78-840c-88777a6ee853"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:01.179887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:01.180436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:01.180967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:01.193811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] Creating event network-vif-deleted:4a259232-6560-4e78-840c-88777a6ee853 for instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 on hv-cinder-85697 Sep 15 14:17:01.199041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-db6644d2-0372-446f-93ad-963c873d4467 req-99f95b3d-a547-4d99-aaa7-59c425acdc1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100628 Sep 15 14:17:01.199760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 398/825] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:01.752963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:01.753840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:01.762234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:01.762863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:01.763433 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:01.764398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:01.764962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:01.765495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:01.979314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:01.980004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:01.980473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:01.980954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lazy-loading 'fault' on Instance uuid 66c972aa-5fee-4e35-a30f-dd5e48f7d108 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:17:02.033143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:02.060164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:02.064425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:02.066049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f44b2c20-b37e-4d54-b2fc-0e7ab1a0dba1 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 200 len: 1370 microversion: 2.20 time: 0.317104 Sep 15 14:17:02.071742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 428/826] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:01 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:03.093183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:03.093933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:03.101979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:03.102136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:03.102514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:03.103215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:03.103699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:03.104117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:03.119946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 HTTP/1.1 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:17:03.121616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:17:03.123296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '66c972aa-5fee-4e35-a30f-dd5e48f7d108'} Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:17:03.124282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:17:03.125802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:03.127151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:17:03.127151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-22b8d718-661f-4f2e-b482-15d77a3240ff tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 404 len: 111 microversion: 2.20 time: 0.034115 Sep 15 14:17:03.127151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 399/827] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:03 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:17:03.131932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-12530ea4-225c-4654-b09d-cf02d1780bd3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '.version_select at 0x7fab4b008a60>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:03.152600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-12530ea4-225c-4654-b09d-cf02d1780bd3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194381711" status: 204 len: 0 microversion: 2.20 time: 0.024385 Sep 15 14:17:03.153195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 429/828] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 15 14:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194381711 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 14:17:03.834578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-12e790ef-72bc-4c07-8b61-cbcbbf48c73c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: .version_select at 0x7fab4761aee0>, body: {"keypair": {"name": "tempest-keypair-251237277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG70SQ93zVCXmOfHcDcSk2TChn6KCV7l5GjCMqehw81yUuCVFuEQTx8q55wHNsWqkXbO05U/laZpivvNmJyU9DIurNgLTZVzElt5qSf1CVt2k7U98f0c6CfUafXYwW3o3Q=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:03.850799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-12e790ef-72bc-4c07-8b61-cbcbbf48c73c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for project e76574d5f2094997a9c565d4ddf2a483. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:17:03.854557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-12e790ef-72bc-4c07-8b61-cbcbbf48c73c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for user 00374d3d3bf649749781792273e35e3b and project e76574d5f2094997a9c565d4ddf2a483. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:17:03.879195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-12e790ef-72bc-4c07-8b61-cbcbbf48c73c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049201 Sep 15 14:17:03.879849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 400/829] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 15 14:17:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 14:17:05.163245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-902676509", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "120cc345-9098-45c5-ab11-9d46cb943f4b"}], "security_groups": [{"name": "tempest-securitygroup--193606540"}], "key_name": "tempest-keypair-251237277", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:05.266416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] validate_networks() for [('120cc345-9098-45c5-ab11-9d46cb943f4b', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:17:05.930523 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:17:05.930943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:17:05.931419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:17:05.931876 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:17:05.932308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:17:05.941029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:05.941766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:05.942864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:05.943991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:05.944453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:05.944877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:05.962272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for project e76574d5f2094997a9c565d4ddf2a483. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:17:05.966092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Getting quotas for user 00374d3d3bf649749781792273e35e3b and project e76574d5f2094997a9c565d4ddf2a483. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:17:05.977628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:17:05.979978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:17:06.027842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9ed02594-95e6-472c-b98b-77209e9e0ff8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.869442 Sep 15 14:17:06.028473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 430/830] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 15 14:17:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 14:17:06.040210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:06.041442 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:06.097247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:06.106507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:06.108041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:06.109958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-71cb5179-272b-4be9-abe8-32b0008c7382 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1280 microversion: 2.20 time: 0.074393 Sep 15 14:17:06.110508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 401/831] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:06 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:07.135336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:07.135985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:07.142074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:07.142551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:07.142986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:07.143677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:07.144154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:07.144576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:07.206235 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:07.214929 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:07.216397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:07.217492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-54238998-5cd4-407c-b087-f35e09038bba tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1332 microversion: 2.20 time: 0.086626 Sep 15 14:17:07.218049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 431/832] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:07 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:17:08.244431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:08.245048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:08.251162 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:08.251929 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:08.252570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:08.253713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:08.254170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:08.255112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:08.465858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:08.474163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:08.475804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:08.476934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72749ab4-b29b-41e1-a06c-c9018c6e3c28 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.236423 Sep 15 14:17:08.477494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 402/833] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:08 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:08.849574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:08.859474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:08.859982 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:08.860412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:08.872154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] Creating event network-changed:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:17:08.877010 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-799ed072-a43d-4e7b-a5fc-3c01c99b5650 req-dbe3b2dc-0ae7-4b2a-81b6-884a5e473623 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032215 Sep 15 14:17:08.877791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 432/834] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:09.502552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:09.503165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:09.510365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:09.510846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:09.511278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:09.512008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:09.512462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:09.512881 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:09.640257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:09.648673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:09.650105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:09.651198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb5012e7-a019-4511-8b89-77656b0adf2c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.152613 Sep 15 14:17:09.651770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 403/835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:09 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:10.677765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:10.678558 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:10.684673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:10.685161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:10.685601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:10.686290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:10.686746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:10.687173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:10.820128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:10.828148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:10.829589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:10.830695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-234b9820-48fd-453d-a3b7-b43a4fb7f3a4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.157850 Sep 15 14:17:10.831252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 433/836] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:10 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:11.856578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:11.857189 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:11.863535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:11.864047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:11.864485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:11.865258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:11.866341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:11.866765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:12.078647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:12.087814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:12.089307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:12.090416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b22908f6-d838-4464-9c28-34f47591747d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.237854 Sep 15 14:17:12.090983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 404/837] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:11 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:13.116329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:13.116964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:13.122738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:13.123219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:13.123648 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:13.124356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:13.124807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:13.125228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:13.257783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:13.265739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:13.267183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:13.268318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-365f77e6-096f-47fe-b4eb-792d8379949f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.156999 Sep 15 14:17:13.268876 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 434/838] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:13 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:14.293884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:14.294488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:14.301295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:14.301775 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:14.302202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:14.303435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:14.303965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:14.304382 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:14.431013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:14.439062 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:14.440506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:14.441595 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4ab36e4d-bd6a-47be-8b09-3c1e80c6a7b9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.151622 Sep 15 14:17:14.442423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 405/839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:14 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:15.056713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "name": "network-vif-plugged", "status": "completed", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:15.063279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:15.071857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:15.072466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:15.073003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:15.087589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] Creating event network-vif-plugged:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:17:15.092683 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-7cf53769-9cea-43f6-b59d-6df35f28f32e req-5cc38730-cd97-465d-9b9d-f790ae90c3c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040498 Sep 15 14:17:15.093287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 435/840] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:15.467666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:15.468294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:15.475384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:15.475903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:15.476334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:15.477020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:15.477468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:15.477888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:15.607793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:15.616946 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:15.618368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:15.619450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a9eba65b-650b-4d49-818a-52a5832a00cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.155684 Sep 15 14:17:15.620038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 406/841] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:15 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:16.642072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:16.642899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:16.648218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:16.648903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:16.656156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:16.656631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:16.657073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:16.657752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:16.658199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:16.658618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:16.786547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:16.795707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:16.797178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:16.798274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8c0a812f-f93f-43f5-830d-852d0edc4c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1405 microversion: 2.20 time: 0.157172 Sep 15 14:17:16.798825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 436/842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:16 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:17.822885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:17.823438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:17.825440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:17.831001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:17.831483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:17.831945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:17.832632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:17.833082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:17.833500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:17.961735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:17.969792 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:17.971216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:17.972400 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b82c4919-d106-48a0-bab9-3ada88b6623c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1596 microversion: 2.20 time: 0.153708 Sep 15 14:17:17.972967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 407/843] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:17:17 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1596 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:17:17.997150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:17.997655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:18.003951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:18.004435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:18.004873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:18.005556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:18.006009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:18.006434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:18.082704 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dc407b5b-8664-41cc-9af7-76aa9c221109 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089325 Sep 15 14:17:18.083299 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 437/844] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 15 14:17:17 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:17:19.000601 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:19.010504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:19.010971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:19.011394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:19.178193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] Creating event network-changed:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:17:19.184184 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-bf5c76e6-c692-4c72-8c53-f36ab1ca0d1b req-3bc6a2d2-bfba-421c-b79f-408d6436c73f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187068 Sep 15 14:17:19.185105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 408/845] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:39.841960 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=5 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:39.842701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=90 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:39.846608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:39.847096 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:39.853712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:39.854195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:39.854638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:39.855330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:39.855814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:39.856244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:39.934813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'services' on Instance uuid fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:17:40.005286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e9d5ccb3-ea8b-4bd5-a97d-987267c69708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments/303d9fcc-e796-407d-bc03-6261c921bb80" status: 202 len: 0 microversion: 2.1 time: 0.164384 Sep 15 14:17:40.005927 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 438/846] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:17:39 2022] DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments/303d9fcc-e796-407d-bc03-6261c921bb80 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:17:40.016431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:40.018627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:40.020921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:40.021689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:40.027229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:40.027625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:40.028105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:40.028880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:40.029328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:40.029754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:40.062523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a7262a43-3e81-4c94-bfa5-83a0acae1947 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051203 Sep 15 14:17:40.063006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 409/847] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:17:40 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:41.015554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:41.017998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:41.025415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.025909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.026353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.027048 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.027512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.027969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.059283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-52228fa2-9a22-4307-a935-9f439c42f178 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048141 Sep 15 14:17:41.059873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 439/848] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:17:41 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:17:41.076252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:41.078407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:41.085680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.086137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.086574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.087275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.087749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.088177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.121151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b925f764-bf83-46d7-8559-d66e3f728995 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049205 Sep 15 14:17:41.121949 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 410/849] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:17:41 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:17:41.130269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:41.130767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:41.138478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.138965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.139423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.140324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.140816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.141240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.168882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:17:41.245673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-911c4e77-2366-4057-942d-535c1d50e2c9 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 204 len: 0 microversion: 2.1 time: 0.118725 Sep 15 14:17:41.246371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 440/850] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:17:41 2022] DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:17:41.255253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:41.255903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:41.262068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.262547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.262987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.263660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:41.264134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:41.264581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:41.395974 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:41.404504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-76a40cbb-9f37-4635-a653-2402dd3d595b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1674 microversion: 2.1 time: 0.153410 Sep 15 14:17:41.405060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 411/851] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:41 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:42.134669 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:42.136893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:42.142895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.143379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.143847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.144539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.145001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.145425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.174040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5f9991e3-cadf-4e13-8fb9-e3de01e55bac tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044302 Sep 15 14:17:42.174594 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 441/852] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:17:42 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:17:42.258918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:42.259450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:42.266153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.266640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.267077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.267797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.268257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.268690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.293272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:17:42.374454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6572bd1d-f939-431f-b43d-517752f109e8 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 204 len: 0 microversion: 2.1 time: 0.119798 Sep 15 14:17:42.375019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 412/853] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:17:42 2022] DELETE /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:17:42.383677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:42.384312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:42.390455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.390883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.391324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.392043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.392501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.392932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.427802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:42.429475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:42.435560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.436154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.436657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.437425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:42.437953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:42.438441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:42.531672 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:42.539795 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8765f2c4-0355-405e-9123-31f578311812 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1689 microversion: 2.1 time: 0.160207 Sep 15 14:17:42.540372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 442/854] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:42 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:42.570151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:42.582964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dc302eee-a2e1-4db6-812d-fe89a4a2687f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1674 microversion: 2.1 time: 0.159127 Sep 15 14:17:42.583934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 413/855] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:42 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:43.562254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:43.562861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:43.570286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:43.570709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:43.571144 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:43.571873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:43.572329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:43.572752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:43.606867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:43.607471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:43.613952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:43.614434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:43.614860 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:43.615553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:43.616544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:43.617262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:43.702240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:43.711084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5f034ac1-d1d7-4988-8d6c-2f8725755e97 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1689 microversion: 2.1 time: 0.151537 Sep 15 14:17:43.711671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 443/856] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:43 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:43.748869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:43.756625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-77ccae02-16b7-408f-8188-f1106b628b0e tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1674 microversion: 2.1 time: 0.153448 Sep 15 14:17:43.757554 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 414/857] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:43 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:44.739908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:44.740516 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:44.747039 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:44.747519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:44.747989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:44.748677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:44.749131 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:44.749554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:44.781159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:44.781793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:44.788312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:44.788791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:44.789220 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:44.789908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:44.790380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:44.790799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:44.878234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:44.886700 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ec776e5f-bf96-45ea-b1dc-2f4a7dec1df9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1689 microversion: 2.1 time: 0.150618 Sep 15 14:17:44.887271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 444/858] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:44 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:44.921772 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:44.929389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dc95a7a9-0b19-4511-9d6e-4c64870d5e36 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1674 microversion: 2.1 time: 0.152071 Sep 15 14:17:44.929957 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 415/859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:44 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:45.910284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:45.911647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:45.920476 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:45.921529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:45.922365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:45.923472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:45.924118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:45.924684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:45.957674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:45.958291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:45.965504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:45.966075 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:45.966568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:45.967615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:45.968288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:45.968787 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:46.064120 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:46.072903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3c26d621-f375-4fee-97f0-4234decf581d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1689 microversion: 2.1 time: 0.166500 Sep 15 14:17:46.073478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 445/860] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:45 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:46.201674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:46.209367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-dc8bc637-c095-4e1d-8445-36b3eff7f8f4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1674 microversion: 2.1 time: 0.256419 Sep 15 14:17:46.210019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 416/861] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:45 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:46.933265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7417b73e-2234-4215-95ab-040a71f66d6b", "name": "network-vif-deleted", "tag": "e3f7891c-8d65-4cff-b08d-3a752660d65a"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:46.957180 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:46.958791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:46.959807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:46.981401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] Creating event network-vif-deleted:e3f7891c-8d65-4cff-b08d-3a752660d65a for instance 7417b73e-2234-4215-95ab-040a71f66d6b on hv-cinder-85697 Sep 15 14:17:46.987129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-27e74516-9b39-4b8a-9a79-8f6ffc58048f req-f160f48f-1da3-432d-a720-bb8dee590c50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062985 Sep 15 14:17:46.987973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 446/862] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:47.096525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:47.097383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:47.108857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.109615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.110292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.111234 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.111948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.112606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.182457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:47.191142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-eb857c82-ed05-489e-8ffe-9bb9178aff09 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1621 microversion: 2.1 time: 0.098397 Sep 15 14:17:47.192339 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 417/863] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:47 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:47.234285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:47.235015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:47.248812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.249305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.251938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.252716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.254902 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.255341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.293550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8", "name": "network-vif-deleted", "tag": "8409c65f-618f-424a-9458-b2d4ffc0defc"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:47.310229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.310524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.311138 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.331513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] Creating event network-vif-deleted:8409c65f-618f-424a-9458-b2d4ffc0defc for instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 on hv-cinder-85697 Sep 15 14:17:47.346981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:47.347620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:47.348172 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:47.348788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lazy-loading 'fault' on Instance uuid 7417b73e-2234-4215-95ab-040a71f66d6b {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:17:47.353266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-6df08e09-411d-4a7a-a441-982cb41edb91 req-fb4a70de-c031-46bc-9aa9-496b13b1fcb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067505 Sep 15 14:17:47.359943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 418/864] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:47.445653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:47.456509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c2219748-d10a-4572-9b3d-56e8c9a14b23 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 200 len: 1327 microversion: 2.1 time: 0.227753 Sep 15 14:17:47.457878 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 447/865] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:47 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 1327 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:48.216408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:48.217111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:48.223971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:48.224470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:48.224907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:48.226328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:48.226897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:48.227323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:48.263244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:48.263759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:48.264206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:48.264656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'fault' on Instance uuid fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:17:48.314252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:48.324488 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de2c7eb7-0e96-47fb-832d-facd4aaa4164 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 200 len: 1334 microversion: 2.1 time: 0.113018 Sep 15 14:17:48.325450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 419/866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:48 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:48.481968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:48.482691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:48.489407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:48.489985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:48.490424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:48.491430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:48.491927 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:48.492352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:48.507043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b HTTP/1.1 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:17:48.508895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:17:48.510554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '7417b73e-2234-4215-95ab-040a71f66d6b'} Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:17:48.511438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:17:48.512911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:48.514050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:17:48.514050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c587741a-8f68-445a-a089-74dc70afd9a7 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 404 len: 111 microversion: 2.1 time: 0.032918 Sep 15 14:17:48.514050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 448/867] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:48 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:17:48.519298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4c710c5d-8244-495e-86a1-4856c4d67d7b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '.version_select at 0x7fab47681d30>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:48.540719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4c710c5d-8244-495e-86a1-4856c4d67d7b tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701967591" status: 202 len: 0 microversion: 2.1 time: 0.025207 Sep 15 14:17:48.541298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 420/868] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 15 14:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701967591 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:17:49.194612 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-483b6dd8-dfc9-431c-bd09-38fa841600e1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: .version_select at 0x7fab4b0834c0>, body: {"keypair": {"name": "tempest-keypair-1013467499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSLEqWyJDZZlxg0taDKGMsI8DEWy/zsY/Iqu7pemucy0Q5KQTdDxr7PuWZPdI9dORPjvnisEH3+2QgTtPB1mnY62wIkvdEc5we9wGb/EHCBjspIxOMs71bgXWNeE1VuOw=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:49.209449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-483b6dd8-dfc9-431c-bd09-38fa841600e1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for project a8297077982a4338a2d687c89e1119a2. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:17:49.214054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-483b6dd8-dfc9-431c-bd09-38fa841600e1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for user 2049d66708ce47a794c14ad4c2040937 and project a8297077982a4338a2d687c89e1119a2. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:17:49.235399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-483b6dd8-dfc9-431c-bd09-38fa841600e1 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045516 Sep 15 14:17:49.236035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 449/869] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:17:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:49.348793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:49.349991 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:49.357150 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:49.357646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:49.358078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:49.358778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:49.359266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:49.359726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:49.374003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] HTTP exception thrown: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Request method failure captured: Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 HTTP/1.1 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIzMGQvybpYHXpUl0WfjKIaM7DDV6NGuHx57yeWD7RgT527KG2NTita9SIHh18fKz1r5xLTtE5dfZCoCRICUszao2ziKZfU13K9oyt4WPOQW9e0xw4-G42Isz-ipC6_d3srTZT84lwujN_2QTqZT4HsejBHWO_pLAdDI4DAZqrl2fc Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:17:49.375797 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fab43b244e854c0296530db48bc1b975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fab43b244e854c0296530db48bc1b975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}] Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 530e6587b39b4f4c98d7414b81453628 Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. Sep 15 14:17:49.377246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8'} Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:17:49.378110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. Sep 15 14:17:49.379402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:49.380547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Returning 404 to user: Instance fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:17:49.380547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-556a3386-088d-42d7-9fef-fc7787ca9664 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8" status: 404 len: 111 microversion: 2.1 time: 0.032374 Sep 15 14:17:49.380547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 421/870] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:49 2022] GET /compute/v2.1/servers/fce3fa2c-0b0d-4fdf-990c-ea13ff865ba8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:17:49.387199 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ecd84e08-acdf-48a1-b654-52eeae5c2de2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '.version_select at 0x7fab4b117ee0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:49.409150 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ecd84e08-acdf-48a1-b654-52eeae5c2de2 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519547951" status: 202 len: 0 microversion: 2.1 time: 0.026390 Sep 15 14:17:49.409872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 450/871] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 15 14:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519547951 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:17:51.139156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1384591997", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8bdfa6d-ee93-493a-aa98-3784c4bb267f"}], "security_groups": [{"name": "tempest-securitygroup--625961970"}], "key_name": "tempest-keypair-1013467499", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:51.262374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] validate_networks() for [('e8bdfa6d-ee93-493a-aa98-3784c4bb267f', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:17:51.632209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:17:51.632719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:17:51.633199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:17:51.633630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:17:51.634041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:17:51.642763 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:51.643249 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:51.643679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:51.644461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:51.644917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:51.645336 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:51.662233 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for project a8297077982a4338a2d687c89e1119a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:17:51.666248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Getting quotas for user 2049d66708ce47a794c14ad4c2040937 and project a8297077982a4338a2d687c89e1119a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:17:51.677188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:17:51.679427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:17:51.725634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5617c4bc-9a53-4310-b59d-183bb4c1927c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590623 Sep 15 14:17:51.726278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 422/872] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:17:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:17:51.737907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0df6b14a-cea7-4d39-92d7-b895c2dbb049 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:51.738520 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0df6b14a-cea7-4d39-92d7-b895c2dbb049 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:51.792886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0df6b14a-cea7-4d39-92d7-b895c2dbb049 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:51.801192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0df6b14a-cea7-4d39-92d7-b895c2dbb049 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1238 microversion: 2.1 time: 0.067401 Sep 15 14:17:51.801839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 451/873] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:51 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:52.335761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:52.336506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:52.343395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.343923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.344360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.345054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.345715 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.346142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.371121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:17:52.452680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4b08447-bf61-41e0-b8be-c5949645c53c tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 204 len: 0 microversion: 2.1 time: 0.121781 Sep 15 14:17:52.454880 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 423/874] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:17:52 2022] DELETE /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:17:52.462079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:52.462797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:52.469387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.469872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.470307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.470998 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.471447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.471895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.600653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:52.608222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2fe1023a-d764-46a5-a0ea-c3d18f092b71 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1508 microversion: 2.1 time: 0.150625 Sep 15 14:17:52.608781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 452/875] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:52 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:52.825988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:52.826614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:52.832556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.833031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.833461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.834141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:52.834743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:52.835167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:52.896391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:52.899914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:52.904462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f8cd7967-2c37-4284-85cb-88683d1a85e5 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1290 microversion: 2.1 time: 0.082784 Sep 15 14:17:52.905032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 424/876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:52 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:53.630850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:53.632552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:53.638742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:53.639247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:53.639675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:53.640624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:53.641254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:53.641856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:53.826644 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bb208e-87b2-4a1d-aadd-6c494d83d01f", "name": "network-vif-deleted", "tag": "37409932-0575-4016-bb98-a4f28388af35"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:53.841108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:53.842550 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:53.843035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:53.856387 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] Creating event network-vif-deleted:37409932-0575-4016-bb98-a4f28388af35 for instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f on hv-cinder-85697 Sep 15 14:17:53.864149 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-59a285fe-e598-434c-aecb-b56710a7861d req-4af4d75f-ad6d-4cc7-bc68-7778ba9123a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041074 Sep 15 14:17:53.865097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 425/877] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:17:53.920776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:53.928612 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:53.929313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:53.935966 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:53.936662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:53.937235 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:53.938117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:53.938289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cd421f28-4e3d-404b-9846-01641c705708 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 200 len: 1508 microversion: 2.1 time: 0.311117 Sep 15 14:17:53.938896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:53.939462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:53.940804 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 453/878] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:53 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:54.010801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:54.020171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-19edfe25-0851-463c-aef5-2c402f7012b8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1296 microversion: 2.1 time: 0.096111 Sep 15 14:17:54.020984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 426/879] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:53 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:54.962857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:54.963478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: 93bb208e-87b2-4a1d-aadd-6c494d83d01f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:54.969985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:54.970478 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:54.970919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:54.971622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:54.972105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:54.972535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:54.986768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] HTTP exception thrown: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Request method failure captured: Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f HTTP/1.1 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIzMGQvybpYHXpUl0WfjKIaM7DDV6NGuHx57yeWD7RgT527KG2NTita9SIHh18fKz1r5xLTtE5dfZCoCRICUszao2ziKZfU13K9oyt4WPOQW9e0xw4-G42Isz-ipC6_d3srTZT84lwujN_2QTqZT4HsejBHWO_pLAdDI4DAZqrl2fc Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:17:54.988401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fab43b244e854c0296530db48bc1b975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fab43b244e854c0296530db48bc1b975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}] Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 530e6587b39b4f4c98d7414b81453628 Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. Sep 15 14:17:54.989727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '93bb208e-87b2-4a1d-aadd-6c494d83d01f'} Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:17:54.991187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. Sep 15 14:17:54.992766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:17:54.993914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Returning 404 to user: Instance 93bb208e-87b2-4a1d-aadd-6c494d83d01f could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:17:54.993914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-47f33326-9817-48fe-a39a-1e218baa316d tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f" status: 404 len: 111 microversion: 2.1 time: 0.031622 Sep 15 14:17:54.993914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 454/880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:54 2022] GET /compute/v2.1/servers/93bb208e-87b2-4a1d-aadd-6c494d83d01f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:17:54.998784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:54.999308 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:55.005678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.006155 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.006586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.007275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.007764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.008154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.033180 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:17:55.044508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:55.045123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:55.052240 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.052794 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.053464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.054815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.056670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.057393 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.120201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2581ba79-b155-4003-b5ac-a05d4ff252ce tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 204 len: 0 microversion: 2.1 time: 0.124783 Sep 15 14:17:55.120796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 427/881] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:17:54 2022] DELETE /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:17:55.129356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:55.130053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:55.137301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.137712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.138140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.138823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.139267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.139706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.257255 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:55.265696 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7cab1190-19af-4d16-8364-f5cf3928d756 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.224953 Sep 15 14:17:55.266737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 455/882] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:55 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:55.276823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:55.285462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b8562b0f-8536-46ea-836f-862772880f34 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.160017 Sep 15 14:17:55.295750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 428/883] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:55 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:55.322851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d55190-61f0-4daf-863c-36b4ad908948", "tag": "bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:55.332547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:55.333139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:55.333657 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:55.345045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] Creating event network-changed:bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d for instance 77d55190-61f0-4daf-863c-36b4ad908948 on hv-cinder-85697 Sep 15 14:17:55.349682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-18f96777-e731-4c47-8394-fd2729593da0 req-6739681e-e3b4-49e1-8f1c-cf6973e43191 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033239 Sep 15 14:17:55.350819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 456/884] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:17:56.289917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:56.290557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:56.297123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:56.297812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:56.298248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:56.298956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:56.299411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:56.299862 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:56.314182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:56.315528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:56.323540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:56.324252 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:56.324883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:56.325765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:56.326369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:56.326950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:56.345833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:17:56.464847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:56.473282 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cfd89785-60a2-41a3-b9f3-ad6c03bf7fe1 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1522 microversion: 2.1 time: 0.167466 Sep 15 14:17:56.473868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 457/885] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:56 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:56.525471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:56.534356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-290d65ed-e2c0-4e90-bf9e-441080548c67 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.248409 Sep 15 14:17:56.535186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 429/886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:56 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:56.559769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27d1fdf-b409-467e-9b03-2a2d60ca01f8", "name": "network-vif-deleted", "tag": "6b330db3-4b2e-4089-b147-9c293a9a00a3"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:17:56.570337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:56.570812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:56.571241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:56.582401 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] Creating event network-vif-deleted:6b330db3-4b2e-4089-b147-9c293a9a00a3 for instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 on hv-cinder-85697 Sep 15 14:17:56.587842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-e0afef72-2424-4577-95d8-74f74015d707 req-35214434-e3dc-4401-987a-8083ad5bb25a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 Sep 15 14:17:56.588462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 458/887] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:17:57.497400 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:57.498005 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:57.504459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:57.504938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:57.505363 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:57.506045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:57.506535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:57.507206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:57.558576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:57.559305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:57.565431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:57.565925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:57.566365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:57.567095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:57.567556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:57.568277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:57.571994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:57.579625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d107c648-4f11-4d3b-a513-b3687ec45713 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1480 microversion: 2.1 time: 0.086072 Sep 15 14:17:57.580221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 430/888] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:57 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1480 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:57.699342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:57.707173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-106c417e-4cf3-42be-ad27-1f4c5dd182c2 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.154205 Sep 15 14:17:57.707756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 459/889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:57 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:17:58.603470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:58.604104 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:58.610479 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:58.610961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:58.611399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:58.612301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:58.612761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:58.613181 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:58.651897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:58.652378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:58.652814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:58.653252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lazy-loading 'fault' on Instance uuid e27d1fdf-b409-467e-9b03-2a2d60ca01f8 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:17:58.699429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e6587b39b4f4c98d7414b81453628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab43b244e854c0296530db48bc1b975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:58.706940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-51452381-8b16-4297-ad3f-cf5ae0ac6f94 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 200 len: 1311 microversion: 2.1 time: 0.108441 Sep 15 14:17:58.707505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 431/890] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:58 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:58.730227 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:58.730837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:58.737232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:58.737717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:58.738156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:58.738849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:58.739307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:58.739766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:58.894266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:17:58.903995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-06f4e8be-471d-44e4-834b-4e1c5565fc99 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.177514 Sep 15 14:17:58.904937 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 460/891] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:58 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:17:59.730665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:59.731212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] [instance: e27d1fdf-b409-467e-9b03-2a2d60ca01f8] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:59.737750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:59.738241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:59.738670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:59.739355 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:59.739839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:59.740268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:59.754072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] HTTP exception thrown: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Request method failure captured: Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 HTTP/1.1 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIzMGQvybpYHXpUl0WfjKIaM7DDV6NGuHx57yeWD7RgT527KG2NTita9SIHh18fKz1r5xLTtE5dfZCoCRICUszao2ziKZfU13K9oyt4WPOQW9e0xw4-G42Isz-ipC6_d3srTZT84lwujN_2QTqZT4HsejBHWO_pLAdDI4DAZqrl2fc Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:17:59.755757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fab43b244e854c0296530db48bc1b975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fab43b244e854c0296530db48bc1b975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fab43b244e854c0296530db48bc1b975"}]}] Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: fab43b244e854c0296530db48bc1b975 Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1635826651 Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 530e6587b39b4f4c98d7414b81453628 Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1635826651-project Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. Sep 15 14:17:59.757296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'e27d1fdf-b409-467e-9b03-2a2d60ca01f8'} Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:17:59.758246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. Sep 15 14:17:59.759773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:17:59.761041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] Returning 404 to user: Instance e27d1fdf-b409-467e-9b03-2a2d60ca01f8 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:17:59.761041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5dcda342-e1d0-4ddc-acb8-fe044c73b6b9 tempest-ServerRescueNegativeTestJSON-1635826651 tempest-ServerRescueNegativeTestJSON-1635826651-project] 10.222.0.27 "GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8" status: 404 len: 111 microversion: 2.1 time: 0.030575 Sep 15 14:17:59.761041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 432/892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:59 2022] GET /compute/v2.1/servers/e27d1fdf-b409-467e-9b03-2a2d60ca01f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:17:59.927870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:17:59.929064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:17:59.936421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:59.937051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:59.937758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:17:59.938731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:17:59.939667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:17:59.940486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:00.073567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:00.081136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6bd230a4-7cf9-41ed-a0c4-13f18486df37 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.158060 Sep 15 14:18:00.081707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 461/893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:17:59 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:01.104867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:01.105548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:01.111988 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:01.112454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:01.112902 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:01.113572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:01.114021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:01.114444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:01.378723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d55190-61f0-4daf-863c-36b4ad908948", "name": "network-vif-plugged", "status": "completed", "tag": "bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:01.389460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:01.392024 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:01.392956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:01.393398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:01.400231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a3f73651-997b-4f18-8b85-7e609b0d881c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.299847 Sep 15 14:18:01.400930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 433/894] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:01 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:01.417864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] Creating event network-vif-plugged:bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d for instance 77d55190-61f0-4daf-863c-36b4ad908948 on hv-cinder-85697 Sep 15 14:18:01.423289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-70ddfcd1-7c98-4bcc-9176-b93d68dc4822 req-b0d3a89f-6aaa-4c43-87ac-1d6e156db70a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048151 Sep 15 14:18:01.424307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 462/895] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:18:02.424083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:02.424807 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:02.426869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:02.427666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:02.434178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:02.434667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:02.435103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:02.435931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:02.436476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:02.436901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:02.723302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:02.731801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-54c5060e-db90-4000-aa30-2bc0d7bceecd tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1363 microversion: 2.1 time: 0.311485 Sep 15 14:18:02.744620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 434/896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:02 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:03.761623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:03.762333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:03.765016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:03.771472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:03.772134 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:03.772633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:03.773331 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:03.773785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:03.774212 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:03.915329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:03.923370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-846de975-2d22-4634-a1ad-774c036b6bbb tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1549 microversion: 2.1 time: 0.166763 Sep 15 14:18:03.924032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 463/897] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:03 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:03.952146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:03.952744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:03.959190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:03.960302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:03.960864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:03.961578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:03.962038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:03.962465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:04.045077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-283bfeaf-6d9d-456d-909a-d896022ed38f tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096856 Sep 15 14:18:04.045663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 435/898] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:18:03 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:05.272526 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d55190-61f0-4daf-863c-36b4ad908948", "tag": "bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:05.283324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:05.283920 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:05.284862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:05.305251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] Creating event network-changed:bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d for instance 77d55190-61f0-4daf-863c-36b4ad908948 on hv-cinder-85697 Sep 15 14:18:05.305251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-1487be96-2274-4fdb-b13e-cb65cb9578d1 req-2d18dbe8-f8e2-48d5-9e1e-7a04d18f24be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034764 Sep 15 14:18:05.305251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 464/899] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:07.656603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1424325707"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:07.657130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:07.663232 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:07.663751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:07.664185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:07.664874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:07.665328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:07.665747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:07.797099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.network.security_group_api [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Removing security group f02c5e1e-ffb1-43e0-9848-33194254a727 from port 8b54bbd9-461c-4eb0-8b69-008918d44954 Sep 15 14:18:08.108605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f9d8d1bb-1a4b-44c7-9b55-694f48f24445 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action" status: 202 len: 0 microversion: 2.1 time: 0.456534 Sep 15 14:18:08.112952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 436/900] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:18:07 2022] POST /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:18:08.121344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:08.132528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:08.133173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:08.133687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:08.146276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] Creating event network-changed:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:18:08.152374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d50ecfd6-e9c5-4f43-af2f-cdf544ed3914 req-789b31f6-c4e3-438a-9ae2-c1276b38c35d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036308 Sep 15 14:18:08.154032 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 465/901] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:18:09.464339 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:09.464888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:09.467845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:09.470711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:09.471403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:09.472037 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:09.472733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:09.473179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:09.473764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:09.479214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:09.479863 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:09.480777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:09.494587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] Creating event network-changed:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:18:09.500214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d09d828c-fbed-4126-8e8f-8420e44238eb req-2dc26715-c63c-4596-b7fd-bad743076e8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037299 Sep 15 14:18:09.501570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 466/902] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:09.557491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lazy-loading 'services' on Instance uuid b381b21a-4b5a-427b-80e7-9fe9ee49c77e {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:18:09.630630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4a17eb02-603b-4191-9c91-df6e5b61b4e8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments/3ef148e7-213b-440a-b39c-b3f970b8689f" status: 202 len: 0 microversion: 2.1 time: 0.172090 Sep 15 14:18:09.631281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 437/903] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:18:09 2022] DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments/3ef148e7-213b-440a-b39c-b3f970b8689f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:18:09.640367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:09.642589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:09.648918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:09.649400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:09.649835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:09.650527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:09.650981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:09.651405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:09.681321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a80430b8-bc1c-4a00-9a5f-55a59cb42ca0 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 15 14:18:09.682073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 467/904] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:18:09 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:10.695794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:10.698074 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:10.700019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:10.705606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:10.706090 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:10.706530 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:10.707223 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:10.707679 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:10.708140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:10.739272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d3a8bd93-9cdd-4fb7-bb5b-ab8b24758e4e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049320 Sep 15 14:18:10.739858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 438/905] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:18:10 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:11.751953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:11.754083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:11.756047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:11.761750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:11.762230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:11.762660 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:11.763340 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:11.763816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:11.764241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:11.796014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b5215675-d3de-4f25-b5cf-645c5fca838e tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048132 Sep 15 14:18:11.796556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 468/906] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:18:11 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:12.808590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:12.810764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:12.817332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:12.817817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:12.818255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:12.819407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:12.819901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:12.820335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:12.849508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83776ccf-0d59-4e00-97cc-67f7954d7dc8 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Sep 15 14:18:12.850842 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 439/907] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:18:12 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:13.862514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:13.864959 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:13.872546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:13.873020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:13.873482 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:13.874173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:13.874623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:13.875043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:13.905119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-62849584-e58c-42c9-9cc6-a24d39c8c29a tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046494 Sep 15 14:18:13.905677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 469/908] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:18:13 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:18:13.916651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:13.918356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:13.924796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:13.925272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:13.925700 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:13.926580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:13.927029 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:13.927449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:14.001123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:18:14.004785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] HTTP exception thrown: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e is not attached to volume 3ef148e7-213b-440a-b39c-b3f970b8689f Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Request method failure captured: Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments/3ef148e7-213b-440a-b39c-b3f970b8689f HTTP/1.1 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzMIN5oAcJXVMxYno8kZ7SSiHBRafXsiXw-KN_vqftYyIQIY2rYnnUTFjp_ZvNI3wh7wgfoMCRfOKxsFNeWXpGHIg_UN1R0qxIW6EktR0KUDzXfOYN1GcJJJQZ-jTI-ng2UQvyRPkni8xhIbz54MaHiqqotzDIuHnxoURzhjdL3PNwg Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 2d56d6c8fce14f2f9fe424a5d0ae2046 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:18:14.016581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}] Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 2d56d6c8fce14f2f9fe424a5d0ae2046 Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-TestMinimumBasicScenario-1539886796-project Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 2bf8e22b8bb2459b83d1c065c0da7145 Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestMinimumBasicScenario-1539886796-project Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:18:14.018194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e is not attached to volume 3ef148e7-213b-440a-b39c-b3f970b8689f Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'server_id': 'b381b21a-4b5a-427b-80e7-9fe9ee49c77e', 'id': '3ef148e7-213b-440a-b39c-b3f970b8689f'} Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ef148e7-213b-440a-b39c-b3f970b8689f. Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:18:14.018981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e is not attached to volume 3ef148e7-213b-440a-b39c-b3f970b8689f Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e is not attached to volume 3ef148e7-213b-440a-b39c-b3f970b8689f Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:14.020222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Returning 404 to user: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e is not attached to volume 3ef148e7-213b-440a-b39c-b3f970b8689f {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:18:14.021142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-329f81cd-f810-47b7-9994-8380a89af906 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments/3ef148e7-213b-440a-b39c-b3f970b8689f" status: 404 len: 154 microversion: 2.1 time: 0.105968 Sep 15 14:18:14.021142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 440/909] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:18:13 2022] DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e/os-volume_attachments/3ef148e7-213b-440a-b39c-b3f970b8689f => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:18:15.162646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:15.163485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:15.169690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:15.170174 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:15.170615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:15.171309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:15.171800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:15.172232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:15.198667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:18:15.281311 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f1197748-fe30-4fa7-9367-dc150afc38d1 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 204 len: 0 microversion: 2.1 time: 0.121828 Sep 15 14:18:15.282584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 470/910] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:18:15 2022] DELETE /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:18:15.291544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:15.292218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:15.302420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:15.302420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:15.302420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:15.302420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:15.302740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:15.302824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:15.434939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:15.442652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e7fab4ec-d6e9-44c1-a6f6-e855ae6f805b tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1555 microversion: 2.1 time: 0.156079 Sep 15 14:18:15.444568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 441/911] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:15 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:16.467494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:16.468280 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:16.474527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:16.475625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:16.476234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:16.476931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:16.477385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:16.477810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:16.613459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:16.624644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c574225d-731b-4bf8-8165-d2b7a3e26678 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1555 microversion: 2.1 time: 0.161574 Sep 15 14:18:16.625432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 471/912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:16 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:17.649837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:17.651411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:17.658071 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:17.658607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:17.659001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:17.659674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:17.660141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:17.660633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:17.862938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf8e22b8bb2459b83d1c065c0da7145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d56d6c8fce14f2f9fe424a5d0ae2046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:18:17.871577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c222f348-6c9e-4788-9660-0ffb9842c3cd tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 200 len: 1555 microversion: 2.1 time: 0.226605 Sep 15 14:18:17.872709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 442/913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:17 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:18:18.016218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b21a-4b5a-427b-80e7-9fe9ee49c77e", "name": "network-vif-deleted", "tag": "8b54bbd9-461c-4eb0-8b69-008918d44954"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:18:18.031694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:18.032197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:18.032633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:18.050368 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] Creating event network-vif-deleted:8b54bbd9-461c-4eb0-8b69-008918d44954 for instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e on hv-cinder-85697 Sep 15 14:18:18.056764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-198b5a88-c4cd-4a78-9ab6-bd54eaf58c8e req-0277557b-3949-48f1-987a-c767c120ddcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046438 Sep 15 14:18:18.057454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 472/914] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:18:18.895428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:18.896077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] [instance: b381b21a-4b5a-427b-80e7-9fe9ee49c77e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:18:18.902537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:18.903021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:18.903450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:18.904171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:18:18.904616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:18:18.905034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:18:18.918770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] HTTP exception thrown: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Request method failure captured: Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e HTTP/1.1 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzMIN5oAcJXVMxYno8kZ7SSiHBRafXsiXw-KN_vqftYyIQIY2rYnnUTFjp_ZvNI3wh7wgfoMCRfOKxsFNeWXpGHIg_UN1R0qxIW6EktR0KUDzXfOYN1GcJJJQZ-jTI-ng2UQvyRPkni8xhIbz54MaHiqqotzDIuHnxoURzhjdL3PNwg Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 2d56d6c8fce14f2f9fe424a5d0ae2046 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:18:18.920335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d56d6c8fce14f2f9fe424a5d0ae2046"}]}] Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 2d56d6c8fce14f2f9fe424a5d0ae2046 Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1539886796 Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-TestMinimumBasicScenario-1539886796-project Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 2bf8e22b8bb2459b83d1c065c0da7145 Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestMinimumBasicScenario-1539886796-project Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. Sep 15 14:18:18.921774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'b381b21a-4b5a-427b-80e7-9fe9ee49c77e'} Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:18:18.922514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. Sep 15 14:18:18.923812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:18:18.924996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Returning 404 to user: Instance b381b21a-4b5a-427b-80e7-9fe9ee49c77e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:18:18.924996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fbac0122-e36a-4b4f-9b37-d515cd817268 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e" status: 404 len: 111 microversion: 2.1 time: 0.030138 Sep 15 14:18:18.924996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 443/915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:18:18 2022] GET /compute/v2.1/servers/b381b21a-4b5a-427b-80e7-9fe9ee49c77e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:18:18.931701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e67b4e61-86f4-4fe0-8bfe-653969956870 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] Calling method '.version_select at 0x7fab4b04eaf0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:18:18.951782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e67b4e61-86f4-4fe0-8bfe-653969956870 tempest-TestMinimumBasicScenario-1539886796 tempest-TestMinimumBasicScenario-1539886796-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063758999" status: 202 len: 0 microversion: 2.1 time: 0.024726 Sep 15 14:18:18.952288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 473/916] 10.222.0.27 () {58 vars in 1272 bytes} [Thu Sep 15 14:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063758999 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:19:11.489908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:11.490491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:11.493135 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=11 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:11.493775 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=14 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:11.500701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:11.501183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:11.501621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:11.502316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:11.502771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:11.503194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:11.528507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-095cc595-2ad0-4176-884a-c0d6779fcfe0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/ips" status: 200 len: 151 microversion: 2.20 time: 0.042464 Sep 15 14:19:11.529113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 444/917] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 15 14:19:11 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:19:13.363119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:13.363976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:13.368300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:13.368985 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:13.376846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:13.377333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:13.377798 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:13.378495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:13.378964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:13.379341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:13.404435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lazy-loading 'flavor' on Instance uuid 7b4ab772-cedd-4a96-b8c8-55909199769f {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:19:13.601097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9fe3a50b-186a-473f-8743-91d3ccfec37f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/action" status: 202 len: 0 microversion: 2.20 time: 0.239334 Sep 15 14:19:13.601729 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 474/918] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 15 14:19:13 2022] POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:19:13.610726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:13.611348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:13.617829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:13.618364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:13.618781 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:13.619568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:13.620059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:13.620485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:13.866474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:13.875899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:13.877411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:13.878907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-349d01ad-ba3b-4749-ab3e-6e23abacd784 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.272823 Sep 15 14:19:13.879386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 445/919] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:13 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:14.906145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:14.907234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:14.914071 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:14.914556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:14.915020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:14.915946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:14.916397 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:14.916818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:15.050514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:15.058533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:15.059991 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:15.061148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1b52cbf3-b17d-4995-992f-7915703c2608 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.160320 Sep 15 14:19:15.062800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 475/920] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:14 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:16.088050 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:16.088657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:16.094971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:16.095459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:16.095932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:16.096629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:16.097088 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:16.097512 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:16.232210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:16.240692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:16.242125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:16.243293 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e82eb1a7-18ef-4c30-b7e6-5f98ee5edb31 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.159246 Sep 15 14:19:16.243877 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 446/921] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:16 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:17.270711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:17.271459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:17.277811 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:17.278299 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:17.278739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:17.279441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:17.279946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:17.281008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:17.416858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:17.425782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:17.427231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:17.428449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0c459b98-2c6b-4e98-a2d5-5ea0b946cd6d tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.161644 Sep 15 14:19:17.429003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 476/922] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:17 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:18.455947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:18.456552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:18.462969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:18.463383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:18.463853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:18.464540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:18.465011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:18.465427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:18.595573 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:18.603549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:18.605007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:18.606163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-005b3067-a130-4430-b816-4446df1ee8c0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.155024 Sep 15 14:19:18.606750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 447/923] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:18 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:19.631524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:19.632075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:19.638323 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:19.638805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:19.639243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:19.640091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:19.640543 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:19.640965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:19.779202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:19.788439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:19.789893 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:19.791063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dbcca95b-3e0d-4103-af89-c634698611fd tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.163552 Sep 15 14:19:19.791617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 477/924] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:19 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:20.817660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:20.818272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:20.824852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:20.825337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:20.825769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:20.826460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:20.826914 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:20.827875 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:20.955029 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:20.963210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:20.964802 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:20.965970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9a7dbf1f-62e1-4c93-b4f6-838d49158a61 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.152232 Sep 15 14:19:20.966610 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 448/925] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:20 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:21.992837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:21.993530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:22.000152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:22.000640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:22.001077 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:22.001767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:22.002222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:22.002647 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:22.139801 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:22.148170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:22.149617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:22.150931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e33e8a75-6623-477e-9406-c43d4ebb0413 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.161851 Sep 15 14:19:22.151489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 478/926] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:21 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:23.177782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:23.178440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:23.184961 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:23.185434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:23.185890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:23.187265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:23.187800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:23.188257 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:23.321599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:23.330255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:23.331711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:23.332851 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-28699707-0adf-4b66-be7e-0217779368eb tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.159005 Sep 15 14:19:23.333405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 449/927] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:23 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:23.859502 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-213230863", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:23.912613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] validate_networks() for None {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:19:24.177121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:19:24.177557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:19:24.178033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:19:24.178481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:19:24.178899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:19:24.187746 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:24.188236 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:24.188679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:24.189413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:24.189874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:24.190306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:24.207001 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Getting quotas for project 45248c0742754b3b8228dd9fa2616724. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:19:24.210911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Getting quotas for user 109e32e9a6a14c22811dd6cacb6e2e56 and project 45248c0742754b3b8228dd9fa2616724. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:19:24.222242 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:19:24.224514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:19:24.268770 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5c8ce034-1a10-413b-a9e8-74eda1647308 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.413253 Sep 15 14:19:24.269584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 479/928] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:19:24.280832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1d499ff2-7e26-42a5-956c-0b6c385fc39c tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:24.282102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1d499ff2-7e26-42a5-956c-0b6c385fc39c tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:24.338593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1d499ff2-7e26-42a5-956c-0b6c385fc39c tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:24.346318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1d499ff2-7e26-42a5-956c-0b6c385fc39c tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1214 microversion: 2.1 time: 0.069795 Sep 15 14:19:24.346905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 450/929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:24 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:24.359924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:24.360328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:24.366671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:24.367154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:24.367595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:24.369139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:24.369139 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:24.369387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:24.506927 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:24.516697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:24.518148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:24.519329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cfa58a10-680b-417d-80ac-f4b130c9e05e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.164956 Sep 15 14:19:24.519908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 480/930] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:24 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:25.370069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:25.370784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:25.378130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:25.378620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:25.379054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:25.379768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:25.380225 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:25.380681 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:25.548738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:25.550318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:25.560380 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:25.561233 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:25.563159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:25.564230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:25.564964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:25.565957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:25.720576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:25.729709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:25.731581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:25.733040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7e391e73-e44d-4da9-98e5-356aa6e42400 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.190881 Sep 15 14:19:25.734064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 481/931] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:25 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:25.741479 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:25.750040 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fca693a4-4671-4460-acb8-c6adf23435e5 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1266 microversion: 2.1 time: 0.383126 Sep 15 14:19:25.750866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 451/932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:25 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:26.761828 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:26.762360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:26.769197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:26.769682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:26.770117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:26.770816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:26.771266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:26.771717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:26.772945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:26.773696 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:26.784268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:26.784760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:26.785192 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:26.785895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:26.786348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:26.786770 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:26.928444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:26.941512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:26.943882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:26.945105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-29a4b0a9-f8c2-4db8-a92c-cb3e1f6a04f0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.187626 Sep 15 14:19:26.946114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 482/933] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:26 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:27.053429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:27.062465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-26b51990-bf22-4ff9-8bef-98fc1aaf6155 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.292764 Sep 15 14:19:27.063078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 452/934] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:26 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:27.429862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef59c7e-1599-4c3f-b1b9-bb976123d01b", "tag": "f187ed79-a9c5-407b-8f65-3b25f04ab221"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:27.439532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:27.440128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:27.440566 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:27.454126 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] Creating event network-changed:f187ed79-a9c5-407b-8f65-3b25f04ab221 for instance fef59c7e-1599-4c3f-b1b9-bb976123d01b on hv-cinder-85697 Sep 15 14:19:27.459321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-ad550d31-7718-465e-a32c-e5b7f594262b req-9eeac11c-def4-4ef1-9e88-277bcc5a81e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Sep 15 14:19:27.460131 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 483/935] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:19:27.647560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "name": "network-vif-plugged", "status": "completed", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:27.658225 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:27.659102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:27.659542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:27.671456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] Creating event network-vif-plugged:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:19:27.676886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-37747e49-5713-4c82-ac9e-1a4ad5bdb7f1 req-4d29c013-3e66-4d6c-9471-f9e4a1f3a7f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Sep 15 14:19:27.677798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 453/936] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:19:27.974159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:27.974892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:27.981232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:27.981720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:27.982157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:27.982854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:27.983337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:27.983967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:28.086468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:28.087172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:28.093317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:28.093806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:28.094247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:28.094956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:28.095417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:28.095878 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:28.114133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:28.122317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:28.123780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:28.125598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-078fe1b1-238a-44ec-903d-8e36aea449ed tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.158246 Sep 15 14:19:28.126161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 484/937] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:27 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:28.227520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:28.235455 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b6d5d785-81f4-404d-a06a-f176f827a765 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.153634 Sep 15 14:19:28.236053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 454/938] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:28 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:29.151534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:29.152112 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:29.158588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:29.159076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:29.159514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:29.160237 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:29.160696 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:29.161133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:29.258228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:29.258925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:29.266359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:29.266921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:29.267422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:29.268239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:29.268693 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:29.269111 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:29.294923 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:29.303297 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:29.304774 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:29.305950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-88b168c6-f075-4c79-9f3d-cc5e82487f19 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.158437 Sep 15 14:19:29.306514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 485/939] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:29 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:29.400120 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:29.408449 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-73c34f55-84da-4cf9-932b-3f6109281139 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.153965 Sep 15 14:19:29.408947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 455/940] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:29 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:30.331425 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:30.332068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:30.338452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:30.338928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:30.339359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:30.340062 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:30.340515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:30.341013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:30.429710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:30.430377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:30.436982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:30.437490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:30.437928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:30.438626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:30.439606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:30.439606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:30.473054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:30.481378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:30.482825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:30.484233 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2747f3f8-0e24-4206-bd34-fd0e33b071f8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.156715 Sep 15 14:19:30.484791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 486/941] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:30 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:30.573168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:30.581278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-895cc491-47dc-444d-94a4-7aaa4b8f6faf tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.155353 Sep 15 14:19:30.581848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 456/942] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:30 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:31.510439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:31.510987 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:31.517847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:31.518335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:31.518766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:31.519455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:31.519932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:31.520406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:31.604053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:31.605291 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:31.612723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:31.613458 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:31.613892 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:31.614581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:31.615182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:31.615798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:31.661168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:31.669317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:31.670900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:31.672845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ed46dae2-3111-4f91-942f-7759c1f0c377 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1742 microversion: 2.20 time: 0.165878 Sep 15 14:19:31.672845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 487/943] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:31 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:31.766493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:31.774760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-27226ba6-2243-42cf-b5e5-cacc2c356665 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.174657 Sep 15 14:19:31.775370 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 457/944] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:31 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:32.699266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:32.699915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:32.707285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:32.708105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:32.708547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:32.709256 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:32.709715 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:32.710142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:32.799314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:32.800503 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:32.808002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:32.808773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:32.809417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:32.810305 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:32.810956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:32.811604 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:32.865618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:32.874128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:32.875919 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:32.877505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-020a4d42-c08e-46a1-8b29-906ae9606c7c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.182996 Sep 15 14:19:32.888118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 488/945] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:32 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:32.965020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:32.977088 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7b1486de-c628-44b9-a6bb-396c33057cc7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.181800 Sep 15 14:19:32.978490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 458/946] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:32 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:33.701017 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef59c7e-1599-4c3f-b1b9-bb976123d01b", "name": "network-vif-plugged", "status": "completed", "tag": "f187ed79-a9c5-407b-8f65-3b25f04ab221"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:33.716013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:33.716792 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:33.717631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:33.734682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] Creating event network-vif-plugged:f187ed79-a9c5-407b-8f65-3b25f04ab221 for instance fef59c7e-1599-4c3f-b1b9-bb976123d01b on hv-cinder-85697 Sep 15 14:19:33.740548 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-d3739445-0047-4baa-a597-7526f32775c0 req-94a4b651-5a15-4e2a-b353-6d290895d88b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045073 Sep 15 14:19:33.741681 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 489/947] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:19:33.904508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:33.905131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:33.920392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:33.921210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:33.921820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:33.922703 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:33.923348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:33.923820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:34.001871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:34.002856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:34.009810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:34.010309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:34.011107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:34.012129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:34.012951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:34.013584 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:34.038301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:34.165377 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:34.166583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:34.175306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b3e7f874-d8c5-4f93-bba0-00f0826fe6bd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.178092 Sep 15 14:19:34.177587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:34.179304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:34.180874 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2394469f-6377-4d79-8ddb-976890d32e67 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.280558 Sep 15 14:19:34.181684 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 459/948] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:33 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:34.191044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 490/949] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:33 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:35.198508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:35.199110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:35.201384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:35.205250 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:35.207192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:35.211936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:35.212407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:35.212533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:35.212833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:35.213050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:35.213726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:35.214176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:35.214803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:35.228081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:35.228579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:35.229023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:35.229749 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:35.236698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:35.237262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:35.378861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:35.387448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f41497d-12cb-4489-84b8-436af1fcb102 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1314 microversion: 2.1 time: 0.192953 Sep 15 14:19:35.391105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 460/950] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:35 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:35.428103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:35.444195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:35.447138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:35.448605 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9dcd901a-09de-49d5-9256-a190d464d1d9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.244114 Sep 15 14:19:35.464580 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 491/951] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:35 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:36.414566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:36.415497 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:36.421995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.422725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.423169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.423903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.424365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.424790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.477480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:36.478129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:36.496774 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.497601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.498046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.498971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.499705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.500146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.596242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:36.604358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8855fb4d-61e1-4ed2-b7c0-5c6aa7c214a7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1463 microversion: 2.1 time: 0.193828 Sep 15 14:19:36.619998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 461/952] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:36 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:36.663403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:36.664440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:36.666887 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:36.677460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:36.677625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.678333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.678948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.679668 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.680011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:36.680146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.680570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.681747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a04a398e-6a1a-47f7-b2ea-2f50a656c6d8 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.208675 Sep 15 14:19:36.684384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 492/953] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:36 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:36.707956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=100 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:36.716817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:19:36.830586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a943fdfb-a5fe-4fd0-8726-cf77ec6747d7 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 204 len: 0 microversion: 2.1 time: 0.172003 Sep 15 14:19:36.839934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:36.840680 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:36.843816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 462/954] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:19:36 2022] DELETE /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 14:19:36.847656 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.848187 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.848623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.849515 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:36.849971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:36.850430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:36.997015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:37.005781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a033ada0-3054-4c0d-b409-c481aad1bf0f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1469 microversion: 2.1 time: 0.169809 Sep 15 14:19:37.013322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 493/955] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:36 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:37.710174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:37.711002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:37.718394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:37.719176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:37.719839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:37.720655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:37.721117 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:37.721542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:38.031483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:38.032736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:38.039372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:38.039886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:38.040317 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:38.041205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:38.041815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:38.042384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:38.090813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:38.099935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:38.101654 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:38.102836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8318b0cb-25cf-406d-b1da-5a2cff065f10 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.397583 Sep 15 14:19:38.103934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 463/956] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:37 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:38.282682 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:38.290698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-abc83bf7-dda3-41a7-bfa9-353285abe0fd tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1469 microversion: 2.1 time: 0.265187 Sep 15 14:19:38.291963 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 494/957] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:38 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:19:39.106301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef59c7e-1599-4c3f-b1b9-bb976123d01b", "name": "network-vif-deleted", "tag": "f187ed79-a9c5-407b-8f65-3b25f04ab221"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:39.132771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.133047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:39.133565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:39.134199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.134840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.149940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] Creating event network-vif-deleted:f187ed79-a9c5-407b-8f65-3b25f04ab221 for instance fef59c7e-1599-4c3f-b1b9-bb976123d01b on hv-cinder-85697 Sep 15 14:19:39.158791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-61d323f5-1297-4049-97a7-953a3efdaf79 req-81e49eca-cb75-4c9f-a6db-768eda810ce7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055109 Sep 15 14:19:39.160070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 464/958] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:19:39.164961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.165482 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.165911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.166845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.167466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.168093 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.321726 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:39.323175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:39.333251 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.333986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.334584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.339022 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.339799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.340399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.378055 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:39.378794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:39.379408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:39.380028 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lazy-loading 'fault' on Instance uuid fef59c7e-1599-4c3f-b1b9-bb976123d01b {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:19:39.382814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:39.392703 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:39.395306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:39.396945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ef211d6b-f03e-4b0d-88b0-73b5c56dc169 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.269947 Sep 15 14:19:39.398189 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 495/959] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:39 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:39.443413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109e32e9a6a14c22811dd6cacb6e2e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45248c0742754b3b8228dd9fa2616724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:39.451736 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2117552d-23c6-454c-9806-491fac6c4714 tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 200 len: 1304 microversion: 2.1 time: 0.134820 Sep 15 14:19:39.464412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 465/960] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:39 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:19:40.431346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:40.432161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:40.440176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:40.443659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:40.444154 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:40.445071 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:40.445809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:40.446668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:40.476846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:40.478408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] [instance: fef59c7e-1599-4c3f-b1b9-bb976123d01b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:40.486978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:40.487829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:40.488708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:40.489617 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:40.490307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:40.490800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:40.509499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] HTTP exception thrown: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Request method failure captured: Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b HTTP/1.1 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzRq5L_ENetEoFAJvo6mOrqktdic-Ky7oNxj_sXPB2KVNKcTvvamogXGx5zrSzTiSLwxAAlRjHjwcMlI-2OrL85ZTvjgulLEGpFjVdKuuiJH52KxPeiyKOjVfTXtTyFfAFfPxLdAYsyeXh7pC1xLzsjntk1Qnrr3ngTPDiMpwulpS7c Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 45248c0742754b3b8228dd9fa2616724 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesNegativeTest-2021766820 Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:19:40.511519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45248c0742754b3b8228dd9fa2616724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45248c0742754b3b8228dd9fa2616724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45248c0742754b3b8228dd9fa2616724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45248c0742754b3b8228dd9fa2616724"}]}] Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesNegativeTest-2021766820 Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 45248c0742754b3b8228dd9fa2616724 Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesNegativeTest-2021766820 Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesNegativeTest-2021766820-project Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 109e32e9a6a14c22811dd6cacb6e2e56 Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesNegativeTest-2021766820-project Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. Sep 15 14:19:40.512943 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'fef59c7e-1599-4c3f-b1b9-bb976123d01b'} Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:19:40.513907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. Sep 15 14:19:40.516231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:19:40.518830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] Returning 404 to user: Instance fef59c7e-1599-4c3f-b1b9-bb976123d01b could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:19:40.518830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6734f0ce-4a74-463e-af52-4bcb1fcb089f tempest-VolumesNegativeTest-2021766820 tempest-VolumesNegativeTest-2021766820-project] 10.222.0.27 "GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b" status: 404 len: 111 microversion: 2.1 time: 0.041059 Sep 15 14:19:40.518830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 466/961] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:19:40 2022] GET /compute/v2.1/servers/fef59c7e-1599-4c3f-b1b9-bb976123d01b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:19:40.639220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:40.649108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:40.651171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:40.652399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5899cac4-b4b8-4bec-90eb-983ecb030d89 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.225704 Sep 15 14:19:40.653480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 496/962] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:40 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:41.679620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:41.680254 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:41.682788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:41.703945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:41.703945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:41.703945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:41.703945 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:41.705105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:41.705105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:41.847659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:41.856613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:41.858047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:41.859496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d85ea6f0-ac20-45ef-a2bb-b4c8250a3912 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1737 microversion: 2.20 time: 0.183721 Sep 15 14:19:41.860137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 467/963] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:41 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:42.886142 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:42.886743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:42.893359 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:42.893857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:42.894294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:42.895130 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:42.895592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:42.896033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:43.037672 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:43.045780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:43.047357 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:43.048565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-308881a7-16a9-4c96-a97a-688a5011bde3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1719 microversion: 2.20 time: 0.166633 Sep 15 14:19:43.049129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 497/964] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:42 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:44.076727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:44.077244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:44.084142 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:44.084619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:44.085047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:44.085728 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:44.086176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:44.086593 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:44.214309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:44.222431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:44.224049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:44.225209 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d0d8d0ea-9cc4-4dfe-b43a-61af96ba1f18 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1719 microversion: 2.20 time: 0.152441 Sep 15 14:19:44.225767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 468/965] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:44 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:45.251181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:45.251986 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:45.254553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:45.260224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.260725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.261198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.261921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.262541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.262979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.403243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:45.412034 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:45.413480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:45.414638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ca405c5e-669e-4348-b9b0-d7965a4602f6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1722 microversion: 2.20 time: 0.167980 Sep 15 14:19:45.415191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 498/966] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:45 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:45.440132 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fd5e318-f3c8-4358-8ad2-ebf0f64ed823"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:45.442517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:45.449395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.449900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.450328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.451622 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.452185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.452631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.707422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "name": "network-vif-unplugged", "status": "completed", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:45.719547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.719996 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.720429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.743222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.compute.server_external_events [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] Unable to find a host for instance 7b4ab772-cedd-4a96-b8c8-55909199769f. Dropping event network-vif-unplugged {{(pid=120647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 14:19:45.743445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c64af986-84af-4018-a334-a9b8769fd167 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307628 Sep 15 14:19:45.744141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-ea543e13-85e9-4db7-9206-68e054773cf9 req-e984189c-4f19-4bbb-b07b-97a69da3a00f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041154 Sep 15 14:19:45.744307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 469/967] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 15 14:19:45 2022] POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 14:19:45.745094 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 499/968] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 14:19:45.873630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:45.874121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:45.881446 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.881926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.882357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:45.883039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:45.883489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:45.883935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:46.117170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6bec237a-e813-442e-9023-26b6714feff2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments/8fd5e318-f3c8-4358-8ad2-ebf0f64ed823" status: 202 len: 0 microversion: 2.20 time: 0.247360 Sep 15 14:19:46.117817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 470/969] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 15 14:19:45 2022] DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments/8fd5e318-f3c8-4358-8ad2-ebf0f64ed823 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:19:46.180423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:46.181101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:46.187101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:46.187591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:46.188068 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:46.188756 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:46.189205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:46.189626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:46.231157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120647) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 14:19:46.299429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-4f1e0343-1dca-40d3-8368-f50ca68008b7 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/action" status: 202 len: 0 microversion: 2.20 time: 0.122742 Sep 15 14:19:46.300132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 500/970] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 15 14:19:46 2022] POST /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:19:46.308237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:46.308959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:46.320731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:46.321532 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:46.322004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:46.322704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:46.323154 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:46.323574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:46.455246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:46.463801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:46.465238 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:46.466406 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6f0d7338-1ae3-4717-aa75-ec986e1529a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1670 microversion: 2.20 time: 0.162188 Sep 15 14:19:46.466964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 471/971] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:46 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:47.492000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:47.492604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:47.499755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:47.500398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:47.500834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:47.501540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:47.501995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:47.502415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:47.639090 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:47.647375 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:47.648839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:47.649993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6e605d8a-2899-4b1c-9b5d-91da45ecf381 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.162021 Sep 15 14:19:47.650849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 501/972] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:47 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:48.676167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:48.676780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:48.683131 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:48.683616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:48.684294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:48.684990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:48.685456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:48.685884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:48.823664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:48.832606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:48.834288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:48.835396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6a340abb-818b-47d4-84ae-0f3ee1f46cc6 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.163163 Sep 15 14:19:48.835979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 472/973] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:48 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:49.864743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:49.865337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:49.872849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:49.873596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:49.874226 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:49.875123 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:49.875783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:49.876540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:50.013336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:50.022689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:50.024175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:50.025358 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ee86fc91-ebd1-4bd1-990d-b0be07f40823 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.164662 Sep 15 14:19:50.025926 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 502/974] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:49 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:50.871183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:50.871886 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:50.884175 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:50.884809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:50.885337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:50.886187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:50.886929 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:50.887596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:50.902666 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:19:50.915239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-64b41055-448d-4f36-828e-6c25ca3100a6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/ips" status: 200 len: 145 microversion: 2.1 time: 0.048056 Sep 15 14:19:50.920517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 473/975] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:19:50 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:19:51.053121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:51.053791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:51.061316 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:51.062088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:51.063164 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:51.064337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:51.065020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:51.067019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:51.258363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:51.268072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:51.269626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:51.271015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-286fc419-7430-45db-93e2-51b27990be2e tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.222436 Sep 15 14:19:51.276629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 503/976] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:51 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:52.298854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:52.299468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:52.307264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:52.308009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:52.308675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:52.309629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:52.310321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:52.310963 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:52.332230 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a20195-a01f-443a-b5fc-0201ab3b72e4"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:19:52.334908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:52.350214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:52.350983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:52.351802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:52.352812 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:52.353432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:52.354018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:52.490044 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:52.500434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:52.502675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:52.504407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d851c03d-66ed-4f3d-9e82-23f01a34b711 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.209753 Sep 15 14:19:52.510287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 474/977] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:52 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:53.530660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:53.531424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:53.539453 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:53.539981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:53.540417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:53.541122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:53.541571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:53.541987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:53.674570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:53.684704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:53.686140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:53.687310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b85ea6d9-e62f-42d0-9ec7-12430fc3eff9 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.160799 Sep 15 14:19:53.688147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 475/978] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:53 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:54.712665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:54.713395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:54.720127 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:54.720944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:54.721603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:54.722561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:54.723093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:54.723585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:54.866854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:54.875099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:54.876561 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:54.877717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ba48a8be-6f82-42e8-a791-f339f9f5b04c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.169053 Sep 15 14:19:54.878283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 476/979] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:54 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:55.906350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:55.907031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:55.914140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:55.914707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:55.915382 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:55.916106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:55.916560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:55.916978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:56.061504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:56.071052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:56.072784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:56.073954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0cb6b46a-6caf-443d-abf3-61057e3813bc tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.171669 Sep 15 14:19:56.074509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 477/980] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:55 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:19:57.298090 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:57.298704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:57.304774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:57.305261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:57.305699 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:57.306397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:57.306853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:57.307276 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:57.438968 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:57.448434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:57.449858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:57.451004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cc8437e6-f620-4870-9348-6f9981f8e0ae tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.355283 Sep 15 14:19:57.451571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 478/981] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:57 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:58.478179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:58.478857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:58.485476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:58.486046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:58.486850 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:58.487377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:58.487931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:58.488427 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:58.888864 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:58.897511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:58.898940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:19:58.900130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-36c7a579-19cc-43dd-ac58-b8b744bc7475 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.427613 Sep 15 14:19:58.900688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 479/982] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:58 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:19:59.925556 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:19:59.926236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:19:59.932840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:59.933326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:59.933757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:19:59.934443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:19:59.934890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:19:59.935309 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:00.062252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:00.070487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:00.072230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:00.073384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6f6f10d3-199a-4913-ac9c-9b6cc832054f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.151754 Sep 15 14:20:00.073952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 480/983] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:19:59 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:20:01.097861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:01.098588 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:01.106494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:01.106989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:01.107429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:01.108160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:01.108619 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:01.109044 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:01.265969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:01.276499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:01.278194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:01.279473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e2c39378-9dc1-48ed-a527-a8350dcb75b2 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.185563 Sep 15 14:20:01.280072 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 481/984] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:01 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:20:02.309819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:02.310486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:02.317034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:02.317678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:02.318167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:02.319229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:02.319720 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:02.320147 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:02.347143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:02.443664 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a5723890-30db-49ab-92d9-37d85db71793 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.115263 Sep 15 14:20:02.447735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 504/985] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:19:52 2022] POST /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 194 bytes in 10117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:02.487883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:02.497247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:02.503463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:02.504687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8a9f0b9c-b42b-4f0f-a71c-8c9bce1ad872 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.202096 Sep 15 14:20:02.505239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 482/986] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:02 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 14:20:03.533065 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:03.534118 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:03.541849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:03.542374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:03.542816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:03.543527 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:03.544205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:03.544641 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:03.563143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:03.679088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:03.687193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:03.688680 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:03.689841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-15d531da-311e-4678-b5ca-1a98e619007c tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.163053 Sep 15 14:20:03.690402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 505/987] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:03 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:04.714686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:04.715298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:04.721759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:04.722241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:04.722676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:04.723365 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:04.723843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:04.724268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:04.857071 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:04.865087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:04.867015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:04.868196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-765a9934-6bcd-437d-8339-a097d94854a0 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.157394 Sep 15 14:20:04.868751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 483/988] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:04 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:05.763265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "name": "network-vif-plugged", "status": "completed", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:20:05.774646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:05.774775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:05.777353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:05.786312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] Creating event network-vif-plugged:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:20:05.791092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-6135349f-8f39-4fc3-91ae-a1854182f447 req-f2a922fa-7548-47bb-92d8-c65cadc95ae9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Sep 15 14:20:05.791741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 506/989] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:05.894350 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:05.895517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:05.902900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:05.903376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:05.903828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:05.904511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:05.904964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:05.905377 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:06.073247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:06.081574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:06.083001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:06.084182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6844462a-76f4-4588-a6cd-e5ea7ef9bf08 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.194051 Sep 15 14:20:06.085484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 484/990] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:05 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:07.111090 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:07.111809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:07.118247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:07.118725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:07.119161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:07.119900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:07.120354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:07.120780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:07.251050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:07.259145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:07.260613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:07.261769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-07146d4b-5daa-49bf-9b81-872ae8f74b32 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.155371 Sep 15 14:20:07.262320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 507/991] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:07 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:08.288335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:08.288900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:08.295016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:08.295498 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:08.295964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:08.296656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:08.297100 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:08.297517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:08.432993 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:08.441119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:08.442587 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:08.444262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-48b52ebf-20cf-4e58-832a-88b5ae231375 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1728 microversion: 2.20 time: 0.160140 Sep 15 14:20:08.444998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 485/992] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:08 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:09.470382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:09.470992 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:09.477505 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:09.477994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:09.478438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:09.479129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:09.479583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:09.480073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:09.606486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:09.614623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:09.616588 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:09.618082 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5bfb8e42-9a84-4e78-8173-8cd2293a8299 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1715 microversion: 2.20 time: 0.151603 Sep 15 14:20:09.618668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 508/993] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:20:09 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:20:09.985559 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:09.987849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:09.994885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:09.995359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:09.995818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:09.996501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:09.996949 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:09.997366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:10.025856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8e6b79cb-b034-484f-8f3f-70d512c345bf tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Sep 15 14:20:10.026399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 486/994] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:20:09 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:10.037055 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:10.037547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:10.044128 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:10.044607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:10.045040 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:10.045723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:10.046173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:10.046591 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:10.076711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1355a0af-2daa-4509-9bb6-2258420486b6 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4" status: 200 len: 194 microversion: 2.1 time: 0.043565 Sep 15 14:20:10.077489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 509/995] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 15 14:20:10 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:11.405767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177b1b9f-56aa-4edc-a62f-56db5b696458"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:20:11.408199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:11.414688 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:11.415166 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:11.415601 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:11.416323 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:11.416775 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:11.417200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:11.673165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-da2a5123-c35b-4952-88d3-3b7d040accfa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "POST /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270838 Sep 15 14:20:11.673767 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 487/996] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:20:11 2022] POST /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:19.205201 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:19.207438 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:19.214623 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.215105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.215542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.216263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.216738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.217149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.248741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9e894826-806d-4cc1-9d5a-04ac1fbc33db tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047405 Sep 15 14:20:19.249285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 510/997] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:20:19 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:19.389314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:19.389854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:19.392471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=42 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:19.398552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.399038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.399476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.400201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.400661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.401085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.430287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1231cd5d-fe38-409a-996a-32273b4457b4 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4" status: 200 len: 194 microversion: 2.1 time: 0.045364 Sep 15 14:20:19.430863 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 488/998] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 15 14:20:19 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:19.441855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:19.442345 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:19.448971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.449459 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.449894 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.450585 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:19.451043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:19.451471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:19.530270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lazy-loading 'services' on Instance uuid 77d55190-61f0-4daf-863c-36b4ad908948 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:20:19.600866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7894c908-d59a-46b5-afb8-76d0ede11782 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4" status: 202 len: 0 microversion: 2.1 time: 0.162950 Sep 15 14:20:19.601489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 511/999] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:20:19 2022] DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/23a20195-a01f-443a-b5fc-0201ab3b72e4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:20:21.781130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:21.781644 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:21.788160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:21.788634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:21.789061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:21.789747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:21.790198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:21.790615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:21.794151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:21.820393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-79cdf6db-a5aa-4f7c-a0d6-51b46f14eefa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/177b1b9f-56aa-4edc-a62f-56db5b696458" status: 200 len: 194 microversion: 2.1 time: 0.043137 Sep 15 14:20:21.821225 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 489/1000] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 15 14:20:21 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/177b1b9f-56aa-4edc-a62f-56db5b696458 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:21.832751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:21.833320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:21.840390 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:21.840868 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:21.841303 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:21.841989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:21.842442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:21.842861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:21.921632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lazy-loading 'services' on Instance uuid 77d55190-61f0-4daf-863c-36b4ad908948 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:20:21.990974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3b3ce2f5-8139-4bbf-b7fa-7f3f28ba068c tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/177b1b9f-56aa-4edc-a62f-56db5b696458" status: 202 len: 0 microversion: 2.1 time: 0.162814 Sep 15 14:20:21.991551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 512/1001] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:20:21 2022] DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments/177b1b9f-56aa-4edc-a62f-56db5b696458 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:20:23.162451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:23.164751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:23.171068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.171552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.172024 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.172716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.173172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.173597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.203078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-01183f63-e7c4-4693-924a-2c41af725696 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044578 Sep 15 14:20:23.203625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 490/1002] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:20:23 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:20:23.319373 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:23.321996 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:23.328063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.328545 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.328977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.329663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.330116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.330539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.358859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-44b3e6b7-bf35-421d-bd46-b212cc406468 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044267 Sep 15 14:20:23.359395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 513/1003] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:20:23 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:20:23.421670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:23.422176 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:23.428747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.429152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.429590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.430280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.430737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.431165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.456465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:20:23.529830 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8c7a4b50-754e-4b32-8885-cb0674a25c5a tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 204 len: 0 microversion: 2.1 time: 0.111701 Sep 15 14:20:23.530621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 491/1004] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:20:23 2022] DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:20:23.539330 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:23.540005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:23.545848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.546337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.546779 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.547483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:23.547964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:23.548394 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:23.679398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:23.687003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-636e5e37-9548-4ffb-b313-00c8b50b3ffa tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1673 microversion: 2.1 time: 0.152358 Sep 15 14:20:23.687560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 514/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:23 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:24.711030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:24.711759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:24.718122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:24.718604 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:24.719038 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:24.719748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:24.720207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:24.720629 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:24.848491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:24.856712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8b91b80c-1006-4a8c-b986-2758dd4dc2e0 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1673 microversion: 2.1 time: 0.150030 Sep 15 14:20:24.857286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 492/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:24 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:25.880468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:25.881699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:25.888148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:25.888638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:25.889078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:25.889767 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:25.890221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:25.890644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:26.017586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:26.025372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ec902b52-165c-4cfd-b4df-cd016a6ad5d8 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1673 microversion: 2.1 time: 0.148754 Sep 15 14:20:26.026156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 515/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:25 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:26.820665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d55190-61f0-4daf-863c-36b4ad908948", "name": "network-vif-deleted", "tag": "bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:20:26.832591 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:26.833066 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:26.833489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:26.845637 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] Creating event network-vif-deleted:bf83e28b-9c2c-4d7e-9b16-55b245aaaf3d for instance 77d55190-61f0-4daf-863c-36b4ad908948 on hv-cinder-85697 Sep 15 14:20:26.851511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-0e6068a9-c2c6-4360-809e-aefdddc905e4 req-fd1d1d34-8048-4414-b582-89a92ac383d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035164 Sep 15 14:20:26.852462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 493/1008] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:27.048463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:27.049176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:27.056785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:27.057969 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:27.058552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:27.059881 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:27.060417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:27.060788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:27.093734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:27.094220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:27.094663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:27.095101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lazy-loading 'fault' on Instance uuid 77d55190-61f0-4daf-863c-36b4ad908948 {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:20:27.136296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2049d66708ce47a794c14ad4c2040937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8297077982a4338a2d687c89e1119a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:20:27.144024 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-014e4643-6c60-4cb2-be34-73cf41951983 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 200 len: 1328 microversion: 2.1 time: 0.099396 Sep 15 14:20:27.144601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 516/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:27 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:28.168202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:28.168896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:28.175041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:28.175523 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:28.175976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:28.176659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:28.177107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:28.177522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:28.193173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 HTTP/1.1 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:20:28.195756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:28.197634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '77d55190-61f0-4daf-863c-36b4ad908948'} Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:28.198743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:28.200318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:28.201799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:28.201799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bdc57563-c7a3-4c52-bc35-c47467ce2679 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 404 len: 111 microversion: 2.1 time: 0.034424 Sep 15 14:20:28.201799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 494/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:28 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:28.206654 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6f02f7ae-5b79-465b-b87a-30c41d604d78 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '.version_select at 0x7fab47903b80>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:28.225002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6f02f7ae-5b79-465b-b87a-30c41d604d78 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013467499" status: 202 len: 0 microversion: 2.1 time: 0.022106 Sep 15 14:20:28.225559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 517/1011] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 15 14:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013467499 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:20:31.097958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:31.098452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:31.105313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:31.105787 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:31.106214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:31.106891 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:31.107340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:31.107785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:31.121933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 HTTP/1.1 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:20:31.123474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.125073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '77d55190-61f0-4daf-863c-36b4ad908948'} Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:31.126094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.127620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.129478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:31.129478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7bfbcccd-b3dd-437f-a149-1f81dfbce130 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 404 len: 111 microversion: 2.1 time: 0.030784 Sep 15 14:20:31.129478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 495/1012] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:20:31 2022] DELETE /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:31.134480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:31.135092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 77d55190-61f0-4daf-863c-36b4ad908948] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:31.143098 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:31.143583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:31.144043 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:31.144739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:31.145194 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:31.145621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:31.158407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 HTTP/1.1 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:20:31.160064 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.161569 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '77d55190-61f0-4daf-863c-36b4ad908948'} Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:31.162596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. Sep 15 14:20:31.164140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:31.165521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 77d55190-61f0-4daf-863c-36b4ad908948 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:31.165521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-039fc306-88af-4b85-b2f4-f5956fcb0494 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948" status: 404 len: 111 microversion: 2.1 time: 0.032157 Sep 15 14:20:31.165521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 518/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:31 2022] GET /compute/v2.1/servers/77d55190-61f0-4daf-863c-36b4ad908948 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:32.298735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:32.299229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:32.305860 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:32.306343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:32.306777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:32.307464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:32.307954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:32.308379 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:32.323010 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b HTTP/1.1 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:20:32.324590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.326226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '7417b73e-2234-4215-95ab-040a71f66d6b'} Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:32.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.328718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.330186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:32.330186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4404311-19d1-44db-81b0-534bbc94d377 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 404 len: 111 microversion: 2.1 time: 0.031104 Sep 15 14:20:32.330186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 496/1014] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:20:32 2022] DELETE /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:32.334474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:32.335107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] [instance: 7417b73e-2234-4215-95ab-040a71f66d6b] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:20:32.342572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:32.343044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:32.343479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:32.344192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:20:32.344645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:20:32.345066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:20:32.358145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] HTTP exception thrown: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Request method failure captured: Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b HTTP/1.1 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzIofzxfYdYtkNQBNxkxUquwFVpuM6wPjdX4ZqzwfabUnJpB3RaAKmFsbiJjUN6JuhXADeUXIOZF8NdM4A9EZs-iUIyyVGxxL7nlv0PQIVQnkchpIz7mI8jSP53FovedKHsjkrRrGT6_LDnGr6PQy1v2Q8I-u7_KqLPkjzx6WL3p70w Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:20:32.359699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8297077982a4338a2d687c89e1119a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8297077982a4338a2d687c89e1119a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8297077982a4338a2d687c89e1119a2"}]}] Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: a8297077982a4338a2d687c89e1119a2 Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-746745544 Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 2049d66708ce47a794c14ad4c2040937 Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeTestJSON-746745544-project Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.361267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '7417b73e-2234-4215-95ab-040a71f66d6b'} Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:32.362222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. Sep 15 14:20:32.363643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:32.364995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] Returning 404 to user: Instance 7417b73e-2234-4215-95ab-040a71f66d6b could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:32.364995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5a32888a-4926-4163-bf8a-3b5b1e48c705 tempest-AttachVolumeTestJSON-746745544 tempest-AttachVolumeTestJSON-746745544-project] 10.222.0.27 "GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b" status: 404 len: 111 microversion: 2.1 time: 0.030422 Sep 15 14:20:32.364995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 519/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:20:32 2022] GET /compute/v2.1/servers/7417b73e-2234-4215-95ab-040a71f66d6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:36.694064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2cc65c88-f53a-46b0-897e-75745f1a7a8d tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Action: 'create', calling method: .version_select at 0x7fab47951a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-833652955"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:20:36.983589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2cc65c88-f53a-46b0-897e-75745f1a7a8d tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.406833 Sep 15 14:20:36.984287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 497/1016] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Sep 15 14:20:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 14:20:36.997945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dfd60916-c74e-40c4-8d60-bf18dad63063 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab478aeca0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:37.048355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dfd60916-c74e-40c4-8d60-bf18dad63063 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 200 len: 344 microversion: 2.1 time: 0.054013 Sep 15 14:20:37.048968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 520/1017] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:36 2022] GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:38.064651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-992542ef-ad84-4c7f-b200-b53f6caac632 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab47935dc0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:38.113615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-992542ef-ad84-4c7f-b200-b53f6caac632 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 200 len: 345 microversion: 2.1 time: 0.053879 Sep 15 14:20:38.114179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 498/1018] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:38 2022] GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:38.127702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eeab317e-1109-45c5-8f72-2b1172778372 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Action: 'create', calling method: .version_select at 0x7fab4b117550>, body: {"snapshot": {"volume_id": "0c719a3e-3548-4a18-866a-aceee049f241", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1789187374"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:20:38.275376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eeab317e-1109-45c5-8f72-2b1172778372 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.151902 Sep 15 14:20:38.276018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 521/1019] 10.222.0.27 () {60 vars in 1162 bytes} [Thu Sep 15 14:20:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:38.287002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e78176c2-26e9-485c-8834-de197c2a9d13 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab47945280>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:38.328199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e78176c2-26e9-485c-8834-de197c2a9d13 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.045082 Sep 15 14:20:38.328805 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 499/1020] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:38 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:38.340519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-672dbde1-78e0-439d-ac3b-1e41846ac0f0 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4afe0550>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:38.370675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-672dbde1-78e0-439d-ac3b-1e41846ac0f0 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033992 Sep 15 14:20:38.371304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 522/1021] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 15 14:20:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:38.383146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-19748c82-e968-4452-ad62-99cfbf53c453 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab479515e0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:38.412954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-19748c82-e968-4452-ad62-99cfbf53c453 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.034338 Sep 15 14:20:38.413594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 500/1022] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:38 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:39.426180 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-cfe58d71-d92d-4517-ad31-befbf3c95e52 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b117e50>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:39.456758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-cfe58d71-d92d-4517-ad31-befbf3c95e52 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.034861 Sep 15 14:20:39.457318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 523/1023] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:39 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:40.469838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-857aa076-2545-42f0-ac72-02230055ceb7 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab478a9430>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:40.500098 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-857aa076-2545-42f0-ac72-02230055ceb7 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.034463 Sep 15 14:20:40.500650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 501/1024] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:40 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:41.513514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-76260032-0247-4f9a-bffb-bcb6ac18ac91 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b032790>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:41.543307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-76260032-0247-4f9a-bffb-bcb6ac18ac91 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.034239 Sep 15 14:20:41.543890 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 524/1025] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:41 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:42.554447 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:42.555188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:42.559411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d0a70158-74f7-4659-bbde-5b972e3ba657 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab478a94c0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:42.590255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d0a70158-74f7-4659-bbde-5b972e3ba657 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 288 microversion: 2.1 time: 0.037673 Sep 15 14:20:42.590825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 502/1026] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:42 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:42.598983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:42.599835 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:20:42.605135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f7317760-6da1-4b89-a8b6-f4887b477fd6 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b1178b0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:42.665964 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f7317760-6da1-4b89-a8b6-f4887b477fd6 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 202 len: 0 microversion: 2.1 time: 0.067721 Sep 15 14:20:42.666540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 525/1027] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 15 14:20:42 2022] DELETE /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:20:42.674656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6191eae3-9e55-47a9-aecc-133e43091970 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4789ad30>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:42.705007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6191eae3-9e55-47a9-aecc-133e43091970 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 200 len: 287 microversion: 2.1 time: 0.034139 Sep 15 14:20:42.705589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 503/1028] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:42 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:43.718567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-aa666a1a-b8ae-4f10-914a-cc2a3069bfd2 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b06da60>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:43.742810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-aa666a1a-b8ae-4f10-914a-cc2a3069bfd2 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] HTTP exception thrown: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-aa666a1a-b8ae-4f10-914a-cc2a3069bfd2 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Request method failure captured: Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a HTTP/1.1 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzS0XODQCx_nKMjZBG2gcj1p2Lme396mZXKocVoVSMMV0wMINfIukS3ppCYXkVFC3j9jqWchwZnDyVeNcqZF-_14UOim-0Uy_pgjiWWVyRMZAAWL5Ev4SrTlTPNlKQtukC0N3Vvfb0Kwa7OB3G2fDLlnxeT0Z1AajvGuPe6ZfneQ1hw Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:20:43.746232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}] Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: fce84576e5f24a2c8dfbca3849c323d1 Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'f605781e-a9f5-4551-ae5e-9236c96eaa4a'} Sep 15 14:20:43.747853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. (HTTP 404) (Request-ID: req-409b48c1-6128-416f-a7e2-2e6204455b3a) Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.748891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:43.750047 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 14:20:43.751202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-aa666a1a-b8ae-4f10-914a-cc2a3069bfd2 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Returning 404 to user: Snapshot f605781e-a9f5-4551-ae5e-9236c96eaa4a could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:43.752572 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-aa666a1a-b8ae-4f10-914a-cc2a3069bfd2 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a" status: 404 len: 111 microversion: 2.1 time: 0.033421 Sep 15 14:20:43.753675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 526/1029] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 15 14:20:43 2022] GET /compute/v2.1/os-snapshots/f605781e-a9f5-4551-ae5e-9236c96eaa4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:43.757525 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e212379a-3e49-438f-9b27-dcb07d555800 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab47945160>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:43.817344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e212379a-3e49-438f-9b27-dcb07d555800 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 202 len: 0 microversion: 2.1 time: 0.064721 Sep 15 14:20:43.817918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 504/1030] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:20:43 2022] DELETE /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:20:43.827870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f4b49750-3bb9-40f0-92d1-c2bedad57a32 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b04eb80>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:43.875439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f4b49750-3bb9-40f0-92d1-c2bedad57a32 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 200 len: 344 microversion: 2.1 time: 0.051366 Sep 15 14:20:43.876109 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 527/1031] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:43 2022] GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:44.891008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-91e6259b-41da-4b61-8b57-0323dc61f998 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4784f940>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:44.919317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-91e6259b-41da-4b61-8b57-0323dc61f998 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] HTTP exception thrown: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-91e6259b-41da-4b61-8b57-0323dc61f998 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Request method failure captured: Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 HTTP/1.1 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzS0XODQCx_nKMjZBG2gcj1p2Lme396mZXKocVoVSMMV0wMINfIukS3ppCYXkVFC3j9jqWchwZnDyVeNcqZF-_14UOim-0Uy_pgjiWWVyRMZAAWL5Ev4SrTlTPNlKQtukC0N3Vvfb0Kwa7OB3G2fDLlnxeT0Z1AajvGuPe6ZfneQ1hw Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:20:44.921376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}] Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: fce84576e5f24a2c8dfbca3849c323d1 Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '0c719a3e-3548-4a18-866a-aceee049f241'} Sep 15 14:20:44.923031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. (HTTP 404) (Request-ID: req-98a8145f-6e89-496f-a232-1353cf7a61c5) Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.924051 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:44.925466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 14:20:44.926829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-91e6259b-41da-4b61-8b57-0323dc61f998 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Returning 404 to user: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-91e6259b-41da-4b61-8b57-0323dc61f998 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 404 len: 109 microversion: 2.1 time: 0.036689 Sep 15 14:20:44.929103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 505/1032] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:44 2022] GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:44.935625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7401312f-462b-4eaa-9c10-3bf8840168eb tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab4b117e50>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:44.963223 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-7401312f-462b-4eaa-9c10-3bf8840168eb tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] HTTP exception thrown: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7401312f-462b-4eaa-9c10-3bf8840168eb tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Request method failure captured: Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: DELETE /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 HTTP/1.1 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzS0XODQCx_nKMjZBG2gcj1p2Lme396mZXKocVoVSMMV0wMINfIukS3ppCYXkVFC3j9jqWchwZnDyVeNcqZF-_14UOim-0Uy_pgjiWWVyRMZAAWL5Ev4SrTlTPNlKQtukC0N3Vvfb0Kwa7OB3G2fDLlnxeT0Z1AajvGuPe6ZfneQ1hw Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:20:44.965634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}] Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: fce84576e5f24a2c8dfbca3849c323d1 Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '0c719a3e-3548-4a18-866a-aceee049f241'} Sep 15 14:20:44.967167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. (HTTP 404) (Request-ID: req-9d694ebe-7852-4997-a062-cb365dcded4b) Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.968269 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 14:20:44.969695 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 14:20:44.971121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7401312f-462b-4eaa-9c10-3bf8840168eb tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Returning 404 to user: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:44.972541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7401312f-462b-4eaa-9c10-3bf8840168eb tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 404 len: 109 microversion: 2.1 time: 0.035690 Sep 15 14:20:44.973583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 528/1033] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:20:44 2022] DELETE /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:44.976079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ada7669-c39d-4f51-b8ff-4032544e70a4 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Calling method '.version_select at 0x7fab47945700>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:45.003210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-9ada7669-c39d-4f51-b8ff-4032544e70a4 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] HTTP exception thrown: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ada7669-c39d-4f51-b8ff-4032544e70a4 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Request method failure captured: Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 HTTP/1.1 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzS0XODQCx_nKMjZBG2gcj1p2Lme396mZXKocVoVSMMV0wMINfIukS3ppCYXkVFC3j9jqWchwZnDyVeNcqZF-_14UOim-0Uy_pgjiWWVyRMZAAWL5Ev4SrTlTPNlKQtukC0N3Vvfb0Kwa7OB3G2fDLlnxeT0Z1AajvGuPe6ZfneQ1hw Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:20:45.005196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9cf766f238e4dcda649e0ae8a0c0926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9cf766f238e4dcda649e0ae8a0c0926"}]}] Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d9cf766f238e4dcda649e0ae8a0c0926 Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1868586773 Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: fce84576e5f24a2c8dfbca3849c323d1 Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1868586773-project Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '0c719a3e-3548-4a18-866a-aceee049f241'} Sep 15 14:20:45.006778 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. (HTTP 404) (Request-ID: req-6fb7affd-aba7-426a-bef3-ff3e5fba7cb5) Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:45.007931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 14:20:45.009288 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 14:20:45.010870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9ada7669-c39d-4f51-b8ff-4032544e70a4 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] Returning 404 to user: Volume 0c719a3e-3548-4a18-866a-aceee049f241 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9ada7669-c39d-4f51-b8ff-4032544e70a4 tempest-VolumesSnapshotsTestJSON-1868586773 tempest-VolumesSnapshotsTestJSON-1868586773-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241" status: 404 len: 109 microversion: 2.1 time: 0.034884 Sep 15 14:20:45.012299 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 506/1034] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:44 2022] GET /compute/v2.1/os-volumes/0c719a3e-3548-4a18-866a-aceee049f241 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:20:47.701315 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ecd548f0-eea8-4327-808e-d69e13d4e3c2 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab4aff6280>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:47.748069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ecd548f0-eea8-4327-808e-d69e13d4e3c2 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0218d658-aefa-4925-ba00-171ebb700b2d" status: 200 len: 350 microversion: 2.1 time: 0.051501 Sep 15 14:20:47.748633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 529/1035] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:47 2022] GET /compute/v2.1/os-volumes/0218d658-aefa-4925-ba00-171ebb700b2d => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:49.082324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b42cfc5b-353f-488d-a6ca-7184ba22134c tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab478f1310>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:49.130252 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b42cfc5b-353f-488d-a6ca-7184ba22134c tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e446b32-2e18-442b-9470-80b56ce24b30" status: 200 len: 351 microversion: 2.1 time: 0.052863 Sep 15 14:20:49.130913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 507/1036] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:49 2022] GET /compute/v2.1/os-volumes/3e446b32-2e18-442b-9470-80b56ce24b30 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:50.470346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ef1cf84b-2043-4d6e-b8e0-41574a530506 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab4b06de50>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:50.517101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ef1cf84b-2043-4d6e-b8e0-41574a530506 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c7adf70a-4798-4906-a9b0-ea63afb10b19" status: 200 len: 351 microversion: 2.1 time: 0.050923 Sep 15 14:20:50.517672 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 530/1037] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes/c7adf70a-4798-4906-a9b0-ea63afb10b19 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:50.531793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-7c8ba9c0-6aaf-4ed0-b6ed-235ab09306f7 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab479515e0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:50.613210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-7c8ba9c0-6aaf-4ed0-b6ed-235ab09306f7 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085686 Sep 15 14:20:50.613780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 508/1038] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:50.627897 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-01565882-2185-4ad3-9ce4-5cddf7a155cc tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab478c80d0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:50.711466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-01565882-2185-4ad3-9ce4-5cddf7a155cc tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087305 Sep 15 14:20:50.712145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 531/1039] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:20:50.726937 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f5f3f74-98b9-45cd-a138-2afc7285aa9b tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab478e0ee0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:50.809045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f5f3f74-98b9-45cd-a138-2afc7285aa9b tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085893 Sep 15 14:20:50.809613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 509/1040] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:50.824005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-be08422e-23c4-41e4-bce9-6345d60e9fa7 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab479b0f70>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:50.909321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-be08422e-23c4-41e4-bce9-6345d60e9fa7 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090379 Sep 15 14:20:50.909898 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 532/1041] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:50.923424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bacef988-41b2-4434-b7ce-38a262825e33 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab478e09d0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:51.005097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bacef988-41b2-4434-b7ce-38a262825e33 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085345 Sep 15 14:20:51.005659 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 510/1042] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 15 14:20:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:51.019886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-df69a9ab-9a4e-4e66-9178-d6bb89e89465 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab479bf040>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:51.102083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-df69a9ab-9a4e-4e66-9178-d6bb89e89465 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085919 Sep 15 14:20:51.102655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 533/1043] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 15 14:20:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:20:51.116386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0f1c6540-2c8a-415f-b750-21b45d5458d0 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab478a98b0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:51.195274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0f1c6540-2c8a-415f-b750-21b45d5458d0 tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083002 Sep 15 14:20:51.196171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 511/1044] 10.222.0.27 () {58 vars in 1188 bytes} [Thu Sep 15 14:20:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:20:51.210013 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f8268b78-9f9e-4f4a-8556-2b33b277acfa tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] Calling method '.version_select at 0x7fab479b0e50>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:20:51.291823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f8268b78-9f9e-4f4a-8556-2b33b277acfa tempest-VolumesTestJSON-2032965614 tempest-VolumesTestJSON-2032965614-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085900 Sep 15 14:20:51.292392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 534/1045] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 15 14:20:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:06.079897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:21:06.080460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments (ip 10.222.0.27) !!! Sep 15 14:21:06.082090 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:21:06.082195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments (ip 10.222.0.27) !!! Sep 15 14:21:06.088719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:06.090884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:06.107755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.108243 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.108671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.109366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.109813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.110265 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.141010 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b2cbbad0-7612-4434-9ec9-604cf6f09daa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061928 Sep 15 14:21:06.141580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 512/1046] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 15 14:21:06 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:06.207766 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:06.208814 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:06.215218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.215749 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.216185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.216873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.217432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.217855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.244156 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:21:06.326751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-795c0206-ee60-46c7-abb0-d08deff52a1a tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 204 len: 0 microversion: 2.20 time: 0.123632 Sep 15 14:21:06.327466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 535/1047] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 15 14:21:06 2022] DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 14:21:06.337843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:06.338516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:06.344374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.344854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.345284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.345969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:06.346416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:06.346835 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:06.481814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:06.490003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:06.491746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:06.492904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2181614e-4509-402b-b8ae-9142dcbff7cf tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.160986 Sep 15 14:21:06.493572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 513/1048] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:06 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:21:07.521613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:07.522324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:07.530135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:07.530628 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:07.531067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:07.531818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:07.532275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:07.532701 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:07.670012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:07.678314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:07.679900 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:07.681133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-144c1317-1fde-441c-b672-2f46ba3055af tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1721 microversion: 2.20 time: 0.164261 Sep 15 14:21:07.681771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 536/1049] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:07 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:21:08.706582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:08.707199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:08.713828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:08.715187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:08.715918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:08.716660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:08.717313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:08.717913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:08.805608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:08.815177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:08.817215 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00374d3d3bf649749781792273e35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76574d5f2094997a9c565d4ddf2a483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:08.818927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9a78a4de-8920-47d1-9e75-f271c722061b tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 200 len: 1654 microversion: 2.20 time: 0.116276 Sep 15 14:21:08.819710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 514/1050] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:08 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 1654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 14:21:08.822277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4ab772-cedd-4a96-b8c8-55909199769f", "name": "network-vif-deleted", "tag": "c1244560-3b75-460d-a38a-c7b6c0b2afaf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:08.834035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:08.834847 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:08.835455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:08.854646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] Creating event network-vif-deleted:c1244560-3b75-460d-a38a-c7b6c0b2afaf for instance 7b4ab772-cedd-4a96-b8c8-55909199769f on hv-cinder-85697 Sep 15 14:21:08.860854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-1a13d662-e4ac-4e1f-b1d0-c56b2a1c0464 req-4479f7e1-b668-4584-aacf-ef53ea31a51f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042595 Sep 15 14:21:08.865345 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 537/1051] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:21:09.849296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:09.849918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:09.856756 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:09.857242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:09.857675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:09.858367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:09.858823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:09.859242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:09.873296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f HTTP/1.1 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:21:09.874853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:09.876723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '7b4ab772-cedd-4a96-b8c8-55909199769f'} Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:21:09.878056 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:09.879631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:09.881172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:21:09.881172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fbab8116-70fd-47cb-9c02-5560b2764148 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 404 len: 111 microversion: 2.20 time: 0.031225 Sep 15 14:21:09.881172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 515/1052] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:09 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:21:09.887889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-64ca8481-4ca5-432e-a87a-f4ba93d46ff4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '.version_select at 0x7fab479bf8b0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:09.907304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-64ca8481-4ca5-432e-a87a-f4ba93d46ff4 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251237277" status: 204 len: 0 microversion: 2.20 time: 0.025008 Sep 15 14:21:09.907909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 538/1053] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 15 14:21:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251237277 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 14:21:11.655289 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:11.655829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:11.662295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:11.662779 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:11.663218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:11.663939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:11.664396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:11.664820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:11.678819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f HTTP/1.1 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:21:11.680401 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.682054 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '7b4ab772-cedd-4a96-b8c8-55909199769f'} Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:21:11.682950 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.684227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.685496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:21:11.685496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c380a658-f78e-4a8c-a77f-a9c96bd7d1aa tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 404 len: 111 microversion: 2.20 time: 0.031075 Sep 15 14:21:11.685496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 516/1054] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 15 14:21:11 2022] DELETE /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:21:11.690514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:11.691249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 7b4ab772-cedd-4a96-b8c8-55909199769f] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:11.698045 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:11.698532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:11.698999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:11.699736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:11.700202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:11.700633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:11.713470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f HTTP/1.1 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:21:11.715644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.717308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '7b4ab772-cedd-4a96-b8c8-55909199769f'} Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:21:11.718220 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. Sep 15 14:21:11.719722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:11.721050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 7b4ab772-cedd-4a96-b8c8-55909199769f could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:21:11.721050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b10a9ec3-2cdc-4b9c-8aa8-20cf3e47bcf3 tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f" status: 404 len: 111 microversion: 2.20 time: 0.030532 Sep 15 14:21:11.721050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 539/1055] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:11 2022] GET /compute/v2.1/servers/7b4ab772-cedd-4a96-b8c8-55909199769f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:21:12.861199 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:12.861700 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:12.868807 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:12.869501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:12.869931 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:12.870674 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:12.871856 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:12.872533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:12.886367 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 HTTP/1.1 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:21:12.888165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.890506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '66c972aa-5fee-4e35-a30f-dd5e48f7d108'} Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:21:12.891589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.893095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.894490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:21:12.894490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3deaf7ef-2912-4dae-87bb-f8bc69342f5f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 404 len: 111 microversion: 2.20 time: 0.032371 Sep 15 14:21:12.894490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 517/1056] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 15 14:21:12 2022] DELETE /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:21:12.898419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:12.899050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] [instance: 66c972aa-5fee-4e35-a30f-dd5e48f7d108] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:12.906388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:12.906942 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:12.907560 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:12.908304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:12.908764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:12.909191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:12.923643 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] HTTP exception thrown: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Request method failure captured: Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 HTTP/1.1 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzI0xbxrIp2IAwpBRqhNYAEBIczOUdszDkeMLE7iUCJvSNqoxQW8f-VgnUq1umXccz2MdaL4w82UqzpNKAmS3b7mrUPI5fTznjNAcVOTM8ZNzKybcU4rNKObKeZNgJb_tv02BGpYbJlif1JunvXjWfo_Qy3-zMEnJtxMmhbtYyYy1w0 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:21:12.925209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e76574d5f2094997a9c565d4ddf2a483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e76574d5f2094997a9c565d4ddf2a483"}]}] Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: e76574d5f2094997a9c565d4ddf2a483 Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228752471 Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 00374d3d3bf649749781792273e35e3b Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228752471-project Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.926853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '66c972aa-5fee-4e35-a30f-dd5e48f7d108'} Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:21:12.927731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. Sep 15 14:21:12.929474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:21:12.930799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] Returning 404 to user: Instance 66c972aa-5fee-4e35-a30f-dd5e48f7d108 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:21:12.930799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-717b668c-2ed0-4a6b-b2a1-efa72ed7db6f tempest-AttachVolumeShelveTestJSON-228752471 tempest-AttachVolumeShelveTestJSON-228752471-project] 10.222.0.27 "GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108" status: 404 len: 111 microversion: 2.20 time: 0.032111 Sep 15 14:21:12.930799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 540/1057] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 15 14:21:12 2022] GET /compute/v2.1/servers/66c972aa-5fee-4e35-a30f-dd5e48f7d108 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:21:23.532884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=12 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:23.534913 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=24 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:23.841063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-31757431-3320-40ef-bac8-2e38a22afa34 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: .version_select at 0x7fab4792b550>, body: {"keypair": {"name": "tempest-keypair-855293506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoCBz2Yp0BL8fWItvNgtaIsyHohqI0SOLvokJNU3QcT5EDQlVzaf+s7dOqCUBmroceWxKToH7lKQj2I4ffTPwRMVZ2sr83K9oHMHbS1AgYJqrH4UqcAFL2nvs0g/yDEXg=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:23.859280 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-31757431-3320-40ef-bac8-2e38a22afa34 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:21:23.863282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-31757431-3320-40ef-bac8-2e38a22afa34 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:21:23.901953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-31757431-3320-40ef-bac8-2e38a22afa34 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.374759 Sep 15 14:21:23.903837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 518/1058] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:21:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:25.813218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1202136298", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48608c61-4597-4efa-9ed7-e6d47fa23e1a"}], "security_groups": [{"name": "tempest-securitygroup--1984118082"}], "key_name": "tempest-keypair-855293506", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:25.822916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:25.824481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:25.956735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] validate_networks() for [('48608c61-4597-4efa-9ed7-e6d47fa23e1a', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:21:26.416356 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:21:26.416787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:21:26.417304 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:21:26.418731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:21:26.419149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:21:26.432015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:26.432508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:26.434065 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:26.435000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:26.435641 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:26.436405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:26.458854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:21:26.464860 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:21:26.483023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:21:26.485892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:21:26.534859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-447e75d9-ae59-4ef9-a545-672b4d324b11 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726716 Sep 15 14:21:26.535512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 541/1059] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:21:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 14:21:26.548017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8276fcbe-07a1-4da4-8566-69867bac43c2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:26.549439 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-8276fcbe-07a1-4da4-8566-69867bac43c2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:26.655386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-8276fcbe-07a1-4da4-8566-69867bac43c2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:26.666658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8276fcbe-07a1-4da4-8566-69867bac43c2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1241 microversion: 2.1 time: 0.122164 Sep 15 14:21:26.670030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 519/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:26 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:27.697960 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:27.698650 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:27.711875 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:27.712956 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:27.713618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:27.714820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:27.715699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:27.716158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:27.856046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:27.887241 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-de317d4d-a1ac-4a9a-a952-4fedc41fc88c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1237 microversion: 2.1 time: 0.193955 Sep 15 14:21:27.902785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 542/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:27 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1237 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:28.925607 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:28.926403 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:28.951014 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:28.952394 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:28.966882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:28.970541 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:28.971301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:28.989021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:29.319179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:29.332269 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-57d2262c-95ca-4d50-a3c0-d3690027543f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1299 microversion: 2.1 time: 0.413936 Sep 15 14:21:29.332858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 520/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:28 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1299 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:30.358391 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:30.359017 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:30.368372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:30.369141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:30.371006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:30.372011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:30.372552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:30.373057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:30.543550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:30.552589 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-98169282-1c5e-4958-9755-20e21d81b150 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.198546 Sep 15 14:21:30.553264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 543/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:30 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:30.774865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d21847ba-02ae-4881-b35e-c25e3616515a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Action: 'create', calling method: .version_select at 0x7fab4784f940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1009678115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7BKLeAa3GvuVPdmCh9MEWEFBJ4sy2SIKcfpvfDhz9EOEoAFSzwqF2I9OuN5w7DUTef3wt87Yos4UZOPT9lIDxNmGprjPF3NcwjyFsd4KRdnZSWKAlzQJgtvr2xxC95Ew=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:30.792959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d21847ba-02ae-4881-b35e-c25e3616515a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Getting quotas for project 3280b84c87ee422c986300291186a41d. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:21:30.797985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-d21847ba-02ae-4881-b35e-c25e3616515a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Getting quotas for user 177058e8e42244faabca6c572a581428 and project 3280b84c87ee422c986300291186a41d. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:21:30.825851 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d21847ba-02ae-4881-b35e-c25e3616515a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268032 Sep 15 14:21:30.827928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 521/1064] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:21:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:31.394697 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1316954-2ee7-42c7-a914-f56173515086", "tag": "3e53009f-b7c0-4a55-9eee-c213b2f6bde1"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:31.416133 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:31.416769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:31.418224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:31.437244 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] Creating event network-changed:3e53009f-b7c0-4a55-9eee-c213b2f6bde1 for instance d1316954-2ee7-42c7-a914-f56173515086 on hv-cinder-85697 Sep 15 14:21:31.443183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-0313c92d-bff7-4ab4-ba3b-32957f9c55d9 req-110c421f-fe65-4a6a-9967-4a62c023919c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052680 Sep 15 14:21:31.445708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 544/1065] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:31.579857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:31.580976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:31.591143 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:31.591589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:31.592926 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:31.593544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:31.594049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:31.594494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:31.916941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:31.933478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d8d23b16-d11b-4632-9d27-8d4b5118c24e tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.359138 Sep 15 14:21:31.949708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 522/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:31 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:32.961376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:32.962291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:32.969339 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:32.970066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:32.970671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:32.971538 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:32.972015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:32.972622 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:33.368528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:33.376181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3966f94e-749e-493f-9605-2f6e67bfe724 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.419133 Sep 15 14:21:33.376797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 545/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:32 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:34.398409 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:34.399115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:34.406103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:34.406585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:34.407012 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:34.407722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:34.408172 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:34.408591 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:34.629838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:34.637673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-6ce55f13-458b-45ae-986f-d2b3fe9c1098 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.243147 Sep 15 14:21:34.638267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 523/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:34 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:35.661820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:35.662553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:35.669116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:35.669602 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:35.670041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:35.671541 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:35.671989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:35.672442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:35.807337 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:35.815645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-750b7914-ee27-4216-8ba4-eb923f88e0bc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.157719 Sep 15 14:21:35.816251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 546/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:35 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:36.839664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:36.840248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:36.847141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:36.847603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:36.848437 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:36.848773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:36.849225 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:36.849648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:36.991287 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:37.003324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e578eab2-a5eb-4cbe-92f3-46c6f82f0693 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.167607 Sep 15 14:21:37.004191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 524/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:36 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:38.027984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:38.028678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:38.033109 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:38.033688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:38.046419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:38.047303 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:38.048029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:38.050853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:38.052321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:38.053127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:38.189631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1316954-2ee7-42c7-a914-f56173515086", "name": "network-vif-plugged", "status": "completed", "tag": "3e53009f-b7c0-4a55-9eee-c213b2f6bde1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:38.202702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:38.203479 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:38.204133 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:38.217704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] Creating event network-vif-plugged:3e53009f-b7c0-4a55-9eee-c213b2f6bde1 for instance d1316954-2ee7-42c7-a914-f56173515086 on hv-cinder-85697 Sep 15 14:21:38.223483 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:38.224863 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-18cc0d20-585c-40a6-9544-923500d3bee8 req-068dbe85-9596-4e5e-927a-201881a30fb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116945 Sep 15 14:21:38.226097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 525/1071] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:21:38.233121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0df8d383-4242-4a64-8abd-27f3fdcf79d9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.210521 Sep 15 14:21:38.233731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 547/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:38 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:39.258152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:39.258843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:39.266276 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:39.266779 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:39.267206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:39.267940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:39.268390 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:39.268811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:39.405589 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:39.413361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-41be2119-4854-439b-ae3b-784653b17cd1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1367 microversion: 2.1 time: 0.159866 Sep 15 14:21:39.413935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 526/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:39 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:40.437385 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:40.437938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:40.444407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:40.444891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:40.445593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:40.446283 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:40.446741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:40.447168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:40.589763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:40.598030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-22b64809-9968-4a5e-b0db-b541c8963fd8 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1558 microversion: 2.1 time: 0.164943 Sep 15 14:21:40.598595 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 548/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:40 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:40.621274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:40.621865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:40.628959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:40.629443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:40.629909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:40.630612 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:40.631069 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:40.631496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:40.713020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c2cabac0-8ea2-468e-b896-dd4ab6753978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095558 Sep 15 14:21:40.713646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 527/1075] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:21:40 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:41.669815 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1316954-2ee7-42c7-a914-f56173515086", "tag": "3e53009f-b7c0-4a55-9eee-c213b2f6bde1"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:41.679946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:41.680453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:41.681069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:41.693739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] Creating event network-changed:3e53009f-b7c0-4a55-9eee-c213b2f6bde1 for instance d1316954-2ee7-42c7-a914-f56173515086 on hv-cinder-85697 Sep 15 14:21:41.699200 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-27b83216-af4d-4362-9c8c-bc00261e67c0 req-a1515aa2-c139-4b90-aa72-a2e831be74b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Sep 15 14:21:41.699948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 549/1076] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:52.848140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=10 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:52.849507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:52.850151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=36 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:52.854259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1292947967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1009678115", "security_groups": [{"name": "tempest-secgroup-smoke-1977594854"}], "networks": [{"uuid": "350ec69d-428d-4e46-965f-648414b78c6c"}], "block_device_mapping_v2": [{"uuid": "435f9b56-b4da-4a96-a950-6571e50f782f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:52.967186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] validate_networks() for [('350ec69d-428d-4e46-965f-648414b78c6c', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:21:53.384122 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:21:53.384546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:21:53.385018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:21:53.385424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:21:53.385832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:21:53.395222 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:53.395729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:53.396168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:53.396901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:53.397358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:53.397785 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:53.414615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Getting quotas for project 3280b84c87ee422c986300291186a41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:21:53.418609 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Getting quotas for user 177058e8e42244faabca6c572a581428 and project 3280b84c87ee422c986300291186a41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:21:53.475333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:21:53.477504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='435f9b56-b4da-4a96-a950-6571e50f782f',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:21:53.605757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bdfe530b-bee7-4b00-b576-b65b0c1e5223 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758367 Sep 15 14:21:53.606402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 528/1077] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:21:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:21:53.615379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:53.616166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=42 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:21:53.621754 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a2f13b3f-b32f-4cbb-9b79-8f9d8ddb8156 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:53.622638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a2f13b3f-b32f-4cbb-9b79-8f9d8ddb8156 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:53.678121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a2f13b3f-b32f-4cbb-9b79-8f9d8ddb8156 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:53.685400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a2f13b3f-b32f-4cbb-9b79-8f9d8ddb8156 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1089 microversion: 2.1 time: 0.071553 Sep 15 14:21:53.686003 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 550/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:53 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:54.709804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:54.710745 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:54.719115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:54.719766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:54.720295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:54.721129 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:54.721673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:54.722202 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:54.813825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:54.822922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-86385520-1728-4484-b82f-11a39ee0891f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1195 microversion: 2.1 time: 0.118598 Sep 15 14:21:54.834901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 529/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:54 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1195 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:55.847055 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:55.847661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:55.855784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:55.856454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:55.856714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:55.857413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:55.858328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:55.858768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:55.994543 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:56.002341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-53f68766-0b72-47a6-9504-8a43192c01f0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.159998 Sep 15 14:21:56.002917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 551/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:55 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:56.149059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:21:56.160759 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:56.161240 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:56.161665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:56.173016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] Creating event network-changed:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:21:56.178062 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-94f75c94-7941-480e-a128-75aaa5914b63 req-268e7515-573a-49df-95ba-18593c44794d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033851 Sep 15 14:21:56.179432 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 530/1081] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:21:57.025465 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:57.026072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:57.033243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:57.033733 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:57.034172 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:57.034870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:57.035327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:57.035781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:57.164674 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:57.172679 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-465f1f8c-1b0e-46e2-bf4a-058a9a731731 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.151068 Sep 15 14:21:57.173262 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 552/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:57 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:58.195538 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:58.196198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:58.202930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:58.203399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:58.203933 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:58.204620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:58.205065 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:58.205580 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:58.339500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:58.356227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d5ac8afc-7be6-4f43-9ff4-50de3e5c6a2a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.165274 Sep 15 14:21:58.356915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 531/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:58 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:21:59.378292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:21:59.378899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:21:59.385291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:59.385768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:59.386203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:59.386888 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:21:59.387340 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:21:59.387793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:21:59.527722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:21:59.535940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a305003b-39cc-46c3-907e-1d0b1778cd97 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.161458 Sep 15 14:21:59.536508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 553/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:21:59 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:00.558444 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:00.559061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:00.566214 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:00.566642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:00.567079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:00.567796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:00.568255 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:00.568684 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:00.704422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:00.712166 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-72820cdd-15ab-4875-8bbe-6240334d9646 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.157571 Sep 15 14:22:00.712731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 532/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:00 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:01.734839 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:01.735448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:01.741795 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:01.742278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:01.742717 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:01.743406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:01.743932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:01.744320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:01.872916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:01.881050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-74687e7d-805d-4626-85d5-c1e6448f1aff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.150579 Sep 15 14:22:01.881615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 554/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:01 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:02.903325 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:02.904033 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:02.910618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:02.911104 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:02.911539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:02.912268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:02.912724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:02.913148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:03.042344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:03.050041 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-db6667e4-fa2e-4703-b701-b193c96c015a tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.150570 Sep 15 14:22:03.050611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 533/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:02 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:04.073546 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:04.074158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:04.077148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:04.082341 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:04.082829 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:04.083265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:04.083981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:04.084435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:04.084861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:04.215331 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:04.223731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6da3e600-9ac6-4d29-981e-b5b4f9ea6942 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.154305 Sep 15 14:22:04.224300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 555/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:04 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:05.245958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:05.246602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:05.248683 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:05.249358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:05.255904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:05.256395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:05.256829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:05.257535 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:05.257987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:05.258412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:05.409378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:05.418190 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a59d5ead-19d3-44f7-ad8b-06fd466ecaf8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.176076 Sep 15 14:22:05.418768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 534/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:05 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:06.444213 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:06.444821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:06.452457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:06.452939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:06.453368 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:06.454052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:06.454528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:06.454946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:06.586989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:06.594929 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f97fc7df-803c-4705-af53-5ad32e54bff7 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.154572 Sep 15 14:22:06.595502 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 556/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:06 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:07.618031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:07.618579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:07.624879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:07.625355 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:07.625786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:07.626466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:07.626919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:07.627333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:07.755391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:07.763058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-56b1aca8-9a31-4ce7-965d-fc68e3952832 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.148930 Sep 15 14:22:07.764342 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 535/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:07 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:08.195734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "name": "network-vif-plugged", "status": "completed", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:22:08.206616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:08.207095 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:08.207523 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:08.219554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] Creating event network-vif-plugged:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:22:08.224808 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-e1cc66f9-3f6d-4840-ac5b-1c06d905d961 req-614edf6d-890d-4208-af7c-15044a98bf51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Sep 15 14:22:08.225458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 557/1092] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:22:08.786173 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:08.786786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:08.793268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:08.793746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:08.794178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:08.795417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:08.795911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:08.796335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:08.929669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:08.937686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-358ab26f-8c41-4632-861c-3456ab3b069d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1261 microversion: 2.1 time: 0.155433 Sep 15 14:22:08.938253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 536/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:08 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:09.961238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:09.961939 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:09.968781 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:09.969264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:09.969699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:09.970388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:09.970840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:09.971263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:10.104590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:10.112460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8b09b6c6-e2af-4d24-be71-88e44883324e tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1445 microversion: 2.1 time: 0.155889 Sep 15 14:22:10.113023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 558/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:09 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:10.134217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:10.134818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:10.142059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:10.142470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:10.142896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:10.143570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:10.144068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:10.144484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:10.274768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:22:10.283522 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96e4b339-311c-4ce4-bfb7-115e69f96d36 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1445 microversion: 2.1 time: 0.153048 Sep 15 14:22:10.284112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 537/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:22:10 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:22:11.948908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:22:11.959378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:11.959965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:11.960424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:11.971318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] Creating event network-changed:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:22:11.976499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-2d179799-e08f-47ff-90ab-736b8c3730f1 req-d7a506a9-d9a0-499c-9e54-c8285babe7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091469 Sep 15 14:22:11.977099 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 559/1096] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:22:56.655810 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:22:56.656429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:56.658761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:56.659424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=52 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:56.667188 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:56.667667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:56.668124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:56.668817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:56.669268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:56.669708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:56.693596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e5e2a8b2-0cad-4668-a168-e228876c72f0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/ips" status: 200 len: 151 microversion: 2.1 time: 0.041923 Sep 15 14:22:56.694157 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 538/1097] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:22:56 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:22:58.052471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=22 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:58.053266 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=46 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:22:58.057796 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fe27634-aa3b-4552-ae0d-211f2fb529aa"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:22:58.060405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:22:58.068221 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:58.068703 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:58.069135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:58.070083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:22:58.070533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:22:58.070952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:22:58.371649 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fc900e3d-289e-4756-be1a-e9ca3acc0721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320328 Sep 15 14:22:58.373107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 560/1098] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:22:58 2022] POST /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:23:05.928648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cc73da85-9030-4766-bf55-d87f693348d4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: .version_select at 0x7fab4784f280>, body: {"keypair": {"name": "tempest-keypair-2014713419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP7S4gYBDICv2izxwAdAlMj7is11PBz7W0fWYS63VWi18sh6UPyKkByQsHbXw8Exe2M2hH4WsjsM7hnY6clmKxMK74u8UXRrnO67wRsUYKKO6A+IW3nlKIYABsUf7Gk/w=="}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:23:05.948552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-cc73da85-9030-4766-bf55-d87f693348d4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:23:05.952520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-cc73da85-9030-4766-bf55-d87f693348d4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:23:05.974993 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cc73da85-9030-4766-bf55-d87f693348d4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050222 Sep 15 14:23:05.975597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 539/1099] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:23:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:23:07.162157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1017993828", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48608c61-4597-4efa-9ed7-e6d47fa23e1a"}], "security_groups": [{"name": "tempest-securitygroup--276279487"}], "key_name": "tempest-keypair-2014713419", "user_data": "}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:23:07.266813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.network.neutron [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] validate_networks() for [('48608c61-4597-4efa-9ed7-e6d47fa23e1a', None, None, None, None, None)] {{(pid=120647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:23:07.679175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:23:07.679603 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image limits 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:23:07.680117 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:23:07.680530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image pref 0:0:0 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:23:07.681022 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.virt.hardware [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:23:07.689752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:07.690238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:07.690677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:07.691410 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:07.691911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:07.692344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:07.709361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:23:07.713499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:23:07.725009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Going to run 1 instances... {{(pid=120647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:23:07.727386 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:23:07.773646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b06258c2-9e84-4a96-9f4f-6b3e7bfbc7bd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616927 Sep 15 14:23:07.774294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 561/1100] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:23:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:23:07.783186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=4 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:23:07.787952 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-966e865c-b296-4779-a458-529d2f9233ad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:07.788575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-966e865c-b296-4779-a458-529d2f9233ad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:07.847049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-966e865c-b296-4779-a458-529d2f9233ad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:07.854194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-966e865c-b296-4779-a458-529d2f9233ad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1242 microversion: 2.1 time: 0.071906 Sep 15 14:23:07.854768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 540/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:07 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:08.878464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:08.879079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:08.886596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:08.887084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:08.887786 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:08.888720 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:08.889348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:08.889778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:08.971834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:08.980363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eb165882-b206-4617-b7d4-c80e94a06781 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1302 microversion: 2.1 time: 0.105874 Sep 15 14:23:08.982056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 562/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:08 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:10.003996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:10.004592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:10.010825 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:10.011308 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:10.011755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:10.012441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:10.012888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:10.013302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:10.145605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:10.153471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3dc101c6-fef6-40bd-87d3-bbf52d7f3467 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.153456 Sep 15 14:23:10.154046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 541/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:09 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:10.365733 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0daab3-8cb7-4360-a1e5-13476c70d800", "tag": "6823da98-87fc-4bab-8e61-edb2eba66bc9"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:23:10.377724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:10.378490 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:10.379398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:10.391455 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] Creating event network-changed:6823da98-87fc-4bab-8e61-edb2eba66bc9 for instance ac0daab3-8cb7-4360-a1e5-13476c70d800 on hv-cinder-85697 Sep 15 14:23:10.396818 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-3f82d63f-6a43-4e6a-aa56-296c613359df req-72a034e4-2981-46d8-a3cb-bfd8cac0198c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035013 Sep 15 14:23:10.397506 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 563/1104] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:23:11.177378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:11.177921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:11.184680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:11.185156 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:11.185582 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:11.186296 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:11.186789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:11.187203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:11.318579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:11.326459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d3b62a34-656d-4197-8eb4-e0b039617159 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.153060 Sep 15 14:23:11.327021 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 542/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:11 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:12.350973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:12.351668 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:12.358231 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:12.358711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:12.359177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:12.360497 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:12.360952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:12.361378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:12.493437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:12.501210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9411f952-29a8-4f92-b872-8f8b3c60b8c3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.154778 Sep 15 14:23:12.501784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 564/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:12 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:13.523547 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:13.524134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:13.530477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:13.531009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:13.531456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:13.532178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:13.532633 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:13.533052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:13.665242 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:13.673086 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1204b907-5c7f-4271-b0ba-7379deea3468 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.153550 Sep 15 14:23:13.673658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 543/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:13 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:14.697113 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:14.697721 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:14.704842 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:14.705320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:14.705753 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:14.706436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:14.706886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:14.707306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:14.834084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:14.841713 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5dcca994-8f05-4293-874f-d7b80b2f8bfc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.148924 Sep 15 14:23:14.842285 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 565/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:14 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:15.864457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:15.865985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:15.872445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:15.872930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:15.873364 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:15.874060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:15.874516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:15.875663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:16.004980 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:16.012553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a447c223-4631-4f39-bc23-de9106f2cd45 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.151999 Sep 15 14:23:16.013125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 544/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:15 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:23:16.701103 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0daab3-8cb7-4360-a1e5-13476c70d800", "name": "network-vif-plugged", "status": "completed", "tag": "6823da98-87fc-4bab-8e61-edb2eba66bc9"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:23:16.712503 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:16.712990 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:16.713470 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:16.724806 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] Creating event network-vif-plugged:6823da98-87fc-4bab-8e61-edb2eba66bc9 for instance ac0daab3-8cb7-4360-a1e5-13476c70d800 on hv-cinder-85697 Sep 15 14:23:16.729955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-33b21e90-0d44-4090-b8ce-7595be1a9558 req-5ded6ffa-f9b9-47f6-8a7c-b13c92b72406 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Sep 15 14:23:16.730556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 566/1110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:23:17.035585 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:17.036237 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:17.042606 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:17.043201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:17.043642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:17.044368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:17.044823 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:17.045279 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:17.178136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:17.185882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f6df5e64-c756-4eca-80c4-1947bd24b447 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.154199 Sep 15 14:23:17.186454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 545/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:17 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:18.207389 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:23:18.208662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:23:18.213206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:18.213929 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:18.221730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:18.222192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:18.222630 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:18.223319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:18.223803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:18.224228 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:18.354727 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:18.363207 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6e5dd31c-e1e3-446a-90f3-5ce56cd797f7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1367 microversion: 2.1 time: 0.156766 Sep 15 14:23:18.363793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 567/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:18 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:19.386030 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:19.386651 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:19.388566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:23:19.394794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:19.395281 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:19.395741 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:19.396436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:19.396893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:19.397318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:19.524752 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:23:19.532733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-26d2d1fb-3a37-4a2f-9af4-6685ccb9c78a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1557 microversion: 2.1 time: 0.150590 Sep 15 14:23:19.533416 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 546/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:23:19 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:23:19.556974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:23:19.557511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:23:19.564409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:19.564891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:19.565378 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:19.566016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:19.566467 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:19.566892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:19.645249 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ae57a0f1-68b2-46f8-8729-c32b572ad874 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092060 Sep 15 14:23:19.645873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 568/1114] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:23:19 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:23:20.790824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0daab3-8cb7-4360-a1e5-13476c70d800", "tag": "6823da98-87fc-4bab-8e61-edb2eba66bc9"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:23:20.800917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:23:20.802086 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:23:20.802884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:23:20.814632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] Creating event network-changed:6823da98-87fc-4bab-8e61-edb2eba66bc9 for instance ac0daab3-8cb7-4360-a1e5-13476c70d800 on hv-cinder-85697 Sep 15 14:23:20.820090 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-15cc07fc-c54c-4b4f-9ec8-9ca3a994818f req-129f5e83-afc6-4733-9df3-429da2d24853 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Sep 15 14:23:20.820692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 547/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:27.167214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:27.167984 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:27.172416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:27.172946 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:27.181148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:27.181633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:27.182074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:27.182768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:27.183224 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:27.183650 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:27.207948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lazy-loading 'flavor' on Instance uuid 62e863a8-235f-45ee-a47a-2deabd16ad2a {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:24:27.277961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-23bb3ab5-4f9c-47de-b49d-9fbe300e4517 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "POST /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a/action" status: 202 len: 0 microversion: 2.1 time: 0.112397 Sep 15 14:24:27.278544 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 569/1116] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:24:27 2022] POST /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:24:27.285450 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:27.286207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=38 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:27.290534 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:27.291230 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:27.298925 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:27.299411 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:27.299964 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:27.300665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:27.301116 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:27.301531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:27.438578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:27.446421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-afa76335-683a-47d6-a7bd-c985a95d4407 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.163086 Sep 15 14:24:27.446985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 548/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:27 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:28.469524 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:28.470217 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:28.476351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:28.476831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:28.477263 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:28.477949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:28.478400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:28.478827 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:28.614153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:28.621841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-338b51fa-e0bd-4ea9-ab32-a9e5923e982c tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.157278 Sep 15 14:24:28.622409 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 570/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:28 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:29.645537 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:29.646077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:29.652595 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:29.653073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:29.653508 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:29.654194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:29.654648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:29.655083 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:29.786737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:29.794443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9c786efe-2224-4414-a5e2-5a16d04ee1cc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.152890 Sep 15 14:24:29.795018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 549/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:29 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:30.818238 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:30.818783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:30.825411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:30.825879 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:30.826308 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:30.826988 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:30.827443 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:30.828659 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:30.956452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:30.964056 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8a96f91d-a202-43aa-b8a8-ed32a39c9628 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.149790 Sep 15 14:24:30.964617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 571/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:30 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:31.987483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:31.988140 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:31.994420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:31.994893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:31.995317 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:31.996020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:31.996470 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:31.996883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:32.127744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:32.135345 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a66417db-e34b-42ca-b1c2-e07ce46dce81 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.152486 Sep 15 14:24:32.135944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 550/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:31 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:33.158561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:33.159201 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:33.165461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:33.165947 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:33.166387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:33.167081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:33.167542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:33.167993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:33.294369 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:33.302211 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-865d9cd0-593e-4d9f-9932-3732410bbfe6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.147507 Sep 15 14:24:33.302787 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 572/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:33 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:34.326477 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:34.327124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:34.333986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:34.334465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:34.334899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:34.335579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:34.336055 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:34.336476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:34.470381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:34.478141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3e321b7c-36c6-4ebd-b7e7-a3d786ff11ea tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.155619 Sep 15 14:24:34.478704 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 551/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:34 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:35.503307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:35.503943 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:35.510243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.510719 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.511149 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:35.511861 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.512307 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.512723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:35.646281 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:35.654027 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c5f3ad88-951a-41cd-a71e-4dd9406a20d5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.154889 Sep 15 14:24:35.654598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 573/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:35 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:35.888565 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:35.889102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:35.896286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.896760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.897186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:35.897869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.898311 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.898722 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:35.922183 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-243e011d-6deb-4cb9-aa19-fb8c7636037a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/ips" status: 200 len: 149 microversion: 2.1 time: 0.039658 Sep 15 14:24:35.922748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 552/1125] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:24:35 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:35.934198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fe27634-aa3b-4552-ae0d-211f2fb529aa"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:35.936635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:35.942710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.943197 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.943638 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:35.944353 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:35.945078 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:35.945532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.024092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: POST /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/os-volume_attachments HTTP/1.1 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 74 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:24:36.026046 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {"volumeAttachment": {"volumeId": "2fe27634-aa3b-4552-ae0d-211f2fb529aa"}} Sep 15 14:24:36.027745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'server_id': 'ac0daab3-8cb7-4360-a1e5-13476c70d800', 'body': {'volumeAttachment': {'volumeId': '2fe27634-aa3b-4552-ae0d-211f2fb529aa'}}} Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:24:36.028864 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:36.030485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 400 to user: Invalid volume: volume 2fe27634-aa3b-4552-ae0d-211f2fb529aa is already attached to instances: d1316954-2ee7-42c7-a914-f56173515086 {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c9ea3190-3fcd-4405-8970-1d6bddd68f95 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097305 Sep 15 14:24:36.032743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 574/1126] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:24:35 2022] POST /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:24:36.037001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:36.037493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:36.043338 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.043844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.044271 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.044944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.045393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.045808 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.071303 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:24:36.148557 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d70ba10-7c2c-4b48-b785-61886eaa85fc tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 204 len: 0 microversion: 2.1 time: 0.114760 Sep 15 14:24:36.149206 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 553/1127] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:24:36 2022] DELETE /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:24:36.157601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:36.158248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:36.167296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.167813 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.168254 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.168948 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.169406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.169832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.297104 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:36.304916 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d4921c89-1b9b-44d5-886a-2fbacd6f0d2f tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1681 microversion: 2.1 time: 0.151236 Sep 15 14:24:36.305487 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 575/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:36 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:36.677486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:36.678107 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:36.680437 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:24:36.680577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a (ip 10.222.0.27) !!! Sep 15 14:24:36.691844 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.692326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.692760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.693445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:36.693896 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:36.694316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:36.826617 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:36.835274 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a480e64c-f7ca-4937-988f-b9dfa48bb445 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.162286 Sep 15 14:24:36.835879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 554/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:36 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:37.330790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:37.331406 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:37.337925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:37.338408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:37.338846 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:37.339542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:37.340030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:37.340460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:37.470273 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:37.477866 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-15b67362-f3d3-4779-9288-beaee27b9646 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1681 microversion: 2.1 time: 0.151632 Sep 15 14:24:37.478434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 576/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:37 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:37.857505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:37.858114 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:37.864869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:37.865344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:37.865773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:37.866453 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:37.866901 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:37.867314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:38.036570 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:38.045036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d81ed689-ae6f-4dd4-841b-8f5c84717d46 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.191302 Sep 15 14:24:38.052996 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 555/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:37 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:38.501678 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:38.502301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:38.509087 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:38.509574 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:38.510009 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:38.510711 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:38.511165 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:38.511590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:38.669909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:38.677567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-935a4e28-454b-456e-90c4-03cfbf8724fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1614 microversion: 2.1 time: 0.180101 Sep 15 14:24:38.678251 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 577/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:38 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1614 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:38.840236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0daab3-8cb7-4360-a1e5-13476c70d800", "name": "network-vif-deleted", "tag": "6823da98-87fc-4bab-8e61-edb2eba66bc9"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:38.849942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:38.850421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:38.850848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:38.864907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] Creating event network-vif-deleted:6823da98-87fc-4bab-8e61-edb2eba66bc9 for instance ac0daab3-8cb7-4360-a1e5-13476c70d800 on hv-cinder-85697 Sep 15 14:24:38.869922 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-17aa06b4-b55f-4b30-a7fa-67b73457bc34 req-e8b842bc-7256-4478-ab68-e1265eebe616 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033267 Sep 15 14:24:38.870845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 556/1133] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:39.069460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:39.070366 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:39.076084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:39.076571 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:39.077008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:39.078257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:39.078716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:39.079135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:39.209449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:39.217243 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5bd48bfb-5175-477e-859f-6c533c4acde4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.151623 Sep 15 14:24:39.217816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 578/1134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:39 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:39.706994 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:39.707730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:39.713822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:39.714310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:39.714746 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:39.715448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:39.715927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:39.716412 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:39.835337 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:39.843423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f2ccf011-6f6c-4531-8753-67aa22a8cf28 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 200 len: 1327 microversion: 2.1 time: 0.143070 Sep 15 14:24:39.844126 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 557/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:39 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:40.242529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:40.243138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:40.250688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:40.251302 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:40.251951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:40.252663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:40.253122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:40.253550 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:40.386306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:40.394699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eb7af950-5e0e-4143-bbfb-07df3b046ff2 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.157728 Sep 15 14:24:40.395270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 579/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:40 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:40.867346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:40.867976 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:40.876671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:40.877219 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:40.877702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:40.878758 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:40.879264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:40.879662 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:40.895786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 HTTP/1.1 Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:24:40.897430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:24:40.899089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'ac0daab3-8cb7-4360-a1e5-13476c70d800'} Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:24:40.900085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:24:40.901597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:40.902960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:24:40.902960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83a0b06b-0854-49a9-af9a-b493abd36d55 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 404 len: 111 microversion: 2.1 time: 0.036247 Sep 15 14:24:40.902960 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 558/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:40 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:24:40.908454 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7700e20f-8841-43aa-a8f1-34fe8956fc39 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '.version_select at 0x7fab478ae820>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:40.928049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7700e20f-8841-43aa-a8f1-34fe8956fc39 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014713419" status: 202 len: 0 microversion: 2.1 time: 0.023508 Sep 15 14:24:40.928613 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 580/1138] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 15 14:24:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014713419 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:24:41.418263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:41.418870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:41.425026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.425505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.425936 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.426664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.427110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.427527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.621218 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:41.630011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ec3920ba-d4e0-4a52-bee9-e1df93a9b195 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1510 microversion: 2.1 time: 0.215595 Sep 15 14:24:41.630590 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 559/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:41 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:41.653539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:41.654182 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:41.654552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:41.655043 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:41.660384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.660874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.661024 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.661310 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.661423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.661766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.661999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.662448 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.662553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.662869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.662970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.663298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.694070 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120647) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 14:24:41.746233 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lazy-loading 'services' on Instance uuid d1316954-2ee7-42c7-a914-f56173515086 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:24:41.763870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3012577a-3235-4dba-be11-c3ad0150e2bd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "POST /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a/action" status: 202 len: 0 microversion: 2.1 time: 0.114641 Sep 15 14:24:41.764542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 581/1140] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 15 14:24:41 2022] POST /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:24:41.772617 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:41.773235 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:41.780014 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.780534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.781116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.781677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.782132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.782553 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.828077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5f193027-9ee4-4de7-96b2-b83c89e101d6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments/2fe27634-aa3b-4552-ae0d-211f2fb529aa" status: 202 len: 0 microversion: 2.1 time: 0.176391 Sep 15 14:24:41.829239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 560/1141] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:24:41 2022] DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments/2fe27634-aa3b-4552-ae0d-211f2fb529aa => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 14:24:41.838467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:41.841598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:41.849773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.850263 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.850718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.851524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:41.852015 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:41.852440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:41.883456 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-929283eb-0ca0-4ab6-8ce9-fe626db4b721 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049621 Sep 15 14:24:41.888706 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 561/1142] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:24:41 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:41.972329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:41.980007 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f9cf7d0f-354f-4354-b636-2fe9144ff215 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1518 microversion: 2.1 time: 0.211097 Sep 15 14:24:41.980581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 582/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:41 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:42.896973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:42.899157 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:42.905532 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:42.906009 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:42.906439 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:42.907126 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:42.907578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:42.908027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:42.936316 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-065990cb-104a-450d-a98c-b8f88ff04748 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043283 Sep 15 14:24:42.937536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 562/1144] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:24:42 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:24:43.005231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:43.005738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:43.007124 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:43.008191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:43.011757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.012441 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.012872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.013592 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.014048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.014465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.016504 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.017088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.017618 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.018691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.019206 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.019853 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.040163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:43.044927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:24:43.048509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:43.139217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fd019cfd-3575-4755-9b89-0c13ec2194eb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 204 len: 0 microversion: 2.1 time: 0.137379 Sep 15 14:24:43.141638 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 563/1145] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:24:42 2022] DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 14:24:43.150514 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:43.151808 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:43.158092 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.158571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.159004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.159740 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:43.160193 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:43.160614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:43.175122 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:43.182731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9f2be48e-35a5-4191-aeb0-890f67143574 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1518 microversion: 2.1 time: 0.184390 Sep 15 14:24:43.183291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 583/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:42 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:43.294938 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:43.303386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-aa1ba60f-5712-4f95-a36b-8943f03c16fa tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1683 microversion: 2.1 time: 0.157227 Sep 15 14:24:43.303995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 564/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:43 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:44.206439 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:44.207053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:44.213451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:44.213935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:44.214370 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:44.215066 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:44.215517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:44.215968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:44.326417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:44.327108 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:44.333965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:44.334516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:44.335013 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:44.335789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:44.336304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:44.336788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:44.356657 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:44.364928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-24a1f7c6-589c-4539-aaa6-d24be18c7d19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1518 microversion: 2.1 time: 0.162479 Sep 15 14:24:44.365501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 584/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:44 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:44.463760 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:44.472425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-feab0853-c779-46a9-9eb3-606db3fa374a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1683 microversion: 2.1 time: 0.149867 Sep 15 14:24:44.472995 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 565/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:44 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:44.984903 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "name": "network-vif-unplugged", "status": "completed", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:44.994649 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:44.995072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:44.995530 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:45.007653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.compute.server_external_events [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] Unable to find a host for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a. Dropping event network-vif-unplugged {{(pid=120647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 14:24:45.008556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-965b0924-8456-40b5-9d81-aed5ab86a13c req-36438662-bce1-45e8-b60f-bbab590e9ed2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028077 Sep 15 14:24:45.009141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 585/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 14:24:45.387735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:45.388392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:45.395536 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:45.396068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:45.396507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:45.397203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:45.397658 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:45.398082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:45.497718 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:45.498938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:45.505462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:45.505953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:45.506509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:45.507225 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:45.507703 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:45.508135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:45.536200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:45.544261 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-339b8b28-989d-4e29-acd4-361046ea69cd tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1518 microversion: 2.1 time: 0.160434 Sep 15 14:24:45.544985 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 566/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:45 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:45.936472 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:45.945115 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ca7c904d-4a3d-4b95-a1ef-23de7e85d109 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1683 microversion: 2.1 time: 0.451219 Sep 15 14:24:45.945684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 586/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:45 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1683 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:46.318846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1316954-2ee7-42c7-a914-f56173515086", "name": "network-vif-deleted", "tag": "3e53009f-b7c0-4a55-9eee-c213b2f6bde1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:46.329239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:46.329862 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:46.330295 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:46.342053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] Creating event network-vif-deleted:3e53009f-b7c0-4a55-9eee-c213b2f6bde1 for instance d1316954-2ee7-42c7-a914-f56173515086 on hv-cinder-85697 Sep 15 14:24:46.348546 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-150c0346-c01e-4b4d-bdef-37a029cf3041 req-a4fe2ee5-9ee4-4f3e-bce1-fb260beeafdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038418 Sep 15 14:24:46.349165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 567/1153] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:46.567726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:46.568325 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:46.574694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:46.575175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:46.575610 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:46.576328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:46.578300 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:46.578925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:46.732219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:46.741635 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6fb55aa4-77ce-4654-834f-2e787f5a01ac tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1520 microversion: 2.1 time: 0.177746 Sep 15 14:24:46.742214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 587/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:46 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:46.970970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:46.971707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:46.983833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:46.984669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:46.985104 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:46.985869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:46.986266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:46.986869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:47.025855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:47.026425 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:47.026958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:47.027549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lazy-loading 'fault' on Instance uuid d1316954-2ee7-42c7-a914-f56173515086 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:24:47.074213 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:47.082701 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c4a96c72-e31e-49a3-a0c0-40833a307401 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 200 len: 1331 microversion: 2.1 time: 0.117075 Sep 15 14:24:47.083286 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 568/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:46 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:47.764877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:47.765542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:47.771978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:47.772464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:47.772905 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:47.773597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:47.774057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:47.774486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:47.909870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:47.917747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-213361a9-dbbc-4826-a1f7-a6b6a3cc0aa6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.156872 Sep 15 14:24:47.918320 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 588/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:47 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:48.106344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:48.107059 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:48.113841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:48.114321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:48.114748 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:48.115473 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:48.115944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:48.116360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:48.130620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 HTTP/1.1 Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:24:48.132292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:24:48.133711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'd1316954-2ee7-42c7-a914-f56173515086'} Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:24:48.134486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:24:48.135791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:24:48.136979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:24:48.136979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e3af1272-0f2a-4c76-a0b7-353176df43a0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 404 len: 111 microversion: 2.1 time: 0.031209 Sep 15 14:24:48.136979 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 569/1157] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:48 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:24:48.143799 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-25e88551-1178-496a-b395-50d41242127a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '.version_select at 0x7fab479f59d0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:48.164083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-25e88551-1178-496a-b395-50d41242127a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-855293506" status: 202 len: 0 microversion: 2.1 time: 0.025180 Sep 15 14:24:48.164671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 589/1158] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 15 14:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-855293506 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:24:48.940362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:48.940984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:48.947205 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:48.947714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:48.948167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:48.948965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:48.949422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:48.949849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:49.017538 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dcc0782d-faa3-4efd-ac58-564aa7749620 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: .version_select at 0x7fab4b08aca0>, body: {"keypair": {"name": "tempest-keypair-1455164408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0YUcJkEE+J6q3yMYW1RzxlpOaNyw2XPRRAJeFNC4404YW+zRCkhDATNYJSqnwnZq8WX6cNfIL4iEEdiSBvowPsw+Ihttk4JhUGoP4vzawymN9Gjg4nv1qo+aeoeDfwmg=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:49.034352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-dcc0782d-faa3-4efd-ac58-564aa7749620 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:24:49.038309 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-dcc0782d-faa3-4efd-ac58-564aa7749620 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:24:49.062918 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dcc0782d-faa3-4efd-ac58-564aa7749620 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050273 Sep 15 14:24:49.063532 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 590/1159] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:24:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:24:49.088776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:49.097357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9aba48e3-1a1d-4a14-9d23-e4a20515ace4 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.160965 Sep 15 14:24:49.097939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 570/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:48 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:50.124348 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:50.125586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:50.131658 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:50.132167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:50.132597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:50.133448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:50.133899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:50.134318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:50.304511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-104936788", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48608c61-4597-4efa-9ed7-e6d47fa23e1a"}], "security_groups": [{"name": "tempest-securitygroup--1406127922"}], "key_name": "tempest-keypair-1455164408", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:50.309245 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:50.318316 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e5ee0a6e-1f9f-4122-a24f-240624da5607 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.200276 Sep 15 14:24:50.318899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 591/1161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:50 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:50.408542 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] validate_networks() for [('48608c61-4597-4efa-9ed7-e6d47fa23e1a', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:24:50.779738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:24:50.780284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:24:50.780812 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:24:50.781258 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:24:50.781673 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:24:50.790524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:50.791007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:50.791443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:50.792210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:50.792670 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:50.793096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:50.810035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:24:50.814806 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:24:50.827151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:24:50.829426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:24:50.876975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-56c43183-d501-47ae-9d35-5f324f50fe25 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577358 Sep 15 14:24:50.877628 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 571/1162] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:24:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 14:24:50.888821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e18e3ead-ff9a-4b4f-8210-1e1120c7cea4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:50.889450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e18e3ead-ff9a-4b4f-8210-1e1120c7cea4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:50.945978 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e18e3ead-ff9a-4b4f-8210-1e1120c7cea4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:50.953336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e18e3ead-ff9a-4b4f-8210-1e1120c7cea4 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1241 microversion: 2.1 time: 0.068390 Sep 15 14:24:50.953917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 592/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:50 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:51.343627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:51.344407 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:51.351115 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:51.351596 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:51.352121 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:51.352816 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:51.353270 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:51.353685 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:51.494575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:51.503765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f2c021e4-b1ca-4dba-bc77-9472a3e66355 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.165261 Sep 15 14:24:51.504343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 572/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:51 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:51.976512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:51.977176 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:51.984152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:51.984152 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:51.984730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:51.985466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:51.985995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:51.986492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:52.063851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:52.071725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-858a0422-3834-4ffe-8b41-33966623cdcf tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1311 microversion: 2.1 time: 0.099808 Sep 15 14:24:52.072367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 593/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:51 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:24:52.527793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:52.528384 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:52.535604 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:52.536169 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:52.536630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:52.537330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:52.537965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:52.538392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:52.678113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:52.687803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b1ccf46a-00ef-4a7b-bfe8-7ef826a0c824 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.163632 Sep 15 14:24:52.688620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 573/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:52 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:53.096287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:53.096822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:53.103319 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:53.103836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:53.104275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:53.104977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:53.105457 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:53.105882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:53.346784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:53.354346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0d5f143d-b4ef-4f2f-ab2c-3c387b46fc94 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.262810 Sep 15 14:24:53.354911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 594/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:53 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:53.711608 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:53.712452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:53.715883 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c39a84-6cce-4bcf-863a-dc4400c55b0e", "tag": "d80795fb-c4c0-43dc-ae59-5ec1a0711341"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:53.721008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:53.721591 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:53.722231 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:53.723130 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:53.723676 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:53.724207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:53.729587 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:53.730196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:53.730855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:53.742570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] Creating event network-changed:d80795fb-c4c0-43dc-ae59-5ec1a0711341 for instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e on hv-cinder-85697 Sep 15 14:24:53.747761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-51f9a63a-6b92-4422-942b-aab17786b664 req-296d8ca6-e1d2-425b-8df6-9c84c6f86887 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036080 Sep 15 14:24:53.748862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 595/1168] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:24:53.874334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:53.882126 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-be84ea89-5020-46ea-a165-2efefb0165c8 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.174443 Sep 15 14:24:53.882710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 574/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:53 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:54.378634 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:54.379327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:54.385512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:54.385989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:54.386421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:54.387108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:54.387557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:54.388011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:54.518821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:54.526405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e524384b-67c2-472e-92ff-3a490ce1b72a tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.152477 Sep 15 14:24:54.526967 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 596/1170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:54 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:54.905869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:54.906393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:54.912857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:54.913340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:54.913776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:54.914465 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:54.914919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:54.915341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:55.047750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:55.055343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-89288677-ba2f-4ac8-a967-ece577019dc5 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.153595 Sep 15 14:24:55.055942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 575/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:54 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:55.550449 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:55.551059 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:55.557480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:55.557962 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:55.558399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:55.559088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:55.559542 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:55.560023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:55.685144 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:55.692849 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b9149ec3-3e68-4dae-85eb-0d4388bb24cb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.146970 Sep 15 14:24:55.693412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 597/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:55 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:56.080103 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:56.080721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:56.087335 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:56.087872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:56.088301 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:56.088984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:56.089460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:56.089873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:56.221177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:56.228860 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-da47bcae-5fa8-44b8-990c-edc64faddb19 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.153349 Sep 15 14:24:56.229426 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 576/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:56 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:56.715994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:56.716599 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:56.723011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:56.723489 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:56.723958 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:56.724639 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:56.725084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:56.725501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:56.857038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:56.865305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6eafa7e7-672b-4392-9353-123c3efeafad tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.153212 Sep 15 14:24:56.865870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 598/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:56 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:57.252330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:57.252883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:57.259264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:57.259769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:57.260195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:57.260873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:57.261321 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:57.261735 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:57.396568 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:57.404410 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e9f2714b-0f12-488b-ab1d-fa44c10b9598 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.156441 Sep 15 14:24:57.404990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 577/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:57 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:57.889663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:57.890190 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:57.893268 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:57.898295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:57.898765 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:57.899193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:57.899908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:57.900361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:57.900778 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:58.040395 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:58.048873 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-855c5a87-a275-4fd8-877b-9c3e025a4287 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.163145 Sep 15 14:24:58.049448 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 599/1176] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:57 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:58.427927 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:58.428548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:58.430967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:24:58.436392 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:58.436872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:58.437429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:58.438308 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:58.438766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:58.439194 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:58.572042 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:58.579962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5e1f29ff-7859-44b6-a65c-db251488908f tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.155889 Sep 15 14:24:58.580539 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 578/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:58 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:59.072820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:59.073737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:59.081008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:59.081741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:59.082143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:59.083579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:59.084447 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:59.084850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:59.222391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c39a84-6cce-4bcf-863a-dc4400c55b0e", "name": "network-vif-plugged", "status": "completed", "tag": "d80795fb-c4c0-43dc-ae59-5ec1a0711341"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:24:59.233909 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:59.234406 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:59.234813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:59.247145 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] Creating event network-vif-plugged:d80795fb-c4c0-43dc-ae59-5ec1a0711341 for instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e on hv-cinder-85697 Sep 15 14:24:59.253379 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-0e283393-0a43-4219-9a12-f32d780ef532 req-d7ca385f-ea36-4ec3-a36b-fee215fd6107 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036445 Sep 15 14:24:59.254460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 579/1178] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:24:59.312321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:59.325044 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2e5da761-d815-4523-aea3-bed08f68ed21 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.256711 Sep 15 14:24:59.326271 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 600/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:59 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:24:59.604832 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:24:59.605528 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:24:59.612776 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:59.613264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:59.613698 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:59.614393 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:24:59.614838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:24:59.615253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:24:59.756491 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:24:59.765014 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-83e5bd5f-71a4-4cc0-a7fb-8d3be13c7e8d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.164751 Sep 15 14:24:59.765962 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 580/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:24:59 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:25:00.349891 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:00.350491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:00.356875 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:00.357346 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:00.357780 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:00.358462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:00.358911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:00.359333 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:00.490208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:25:00.497731 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2a21b95a-fe5b-4fa4-b0e4-6b729bea572c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1367 microversion: 2.1 time: 0.151723 Sep 15 14:25:00.498423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 601/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:25:00 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:25:00.788969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:00.789612 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:00.795940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:00.796413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:00.796838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:00.797526 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:00.798070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:00.798485 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:00.801139 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:25:00.803221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:25:00.821495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:25:00.934210 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:25:00.942667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-87f1efc7-e32c-4230-936a-fa932e2c19c6 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.157515 Sep 15 14:25:00.943244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 581/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:25:00 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:25:01.270973 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "name": "network-vif-plugged", "status": "completed", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:25:01.275855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:25:01.283006 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.283540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.284005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.296630 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] Creating event network-vif-plugged:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:25:01.303621 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-8d0182c2-757d-4743-b8a5-06a3c1ff9e5e req-5a3a9b88-d9ad-4b37-aa40-13cca4ecf190 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036677 Sep 15 14:25:01.304707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 602/1183] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:25:01.521908 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:01.522438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:01.528397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.528879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.529315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.530006 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.530475 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.530882 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.695036 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:25:01.702774 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-837d8057-f42a-4e5d-99af-173452e809e7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1557 microversion: 2.1 time: 0.184819 Sep 15 14:25:01.703348 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 582/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:25:01 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:25:01.726035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:01.726631 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:01.733147 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.733633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.734073 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.734761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.735218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.735840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.812161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b58048f9-35d2-46d1-95f7-128a4a26b668 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090203 Sep 15 14:25:01.812785 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 603/1185] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:25:01 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:25:01.966464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:01.967060 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:01.974089 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.974572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.975000 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:01.975717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:01.976162 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:01.977732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:02.115907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:25:02.123920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0c8a04f6-4078-4cae-8135-f27736e1fd69 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1576 microversion: 2.1 time: 0.161325 Sep 15 14:25:02.124524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 583/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:25:01 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:25:02.965509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c39a84-6cce-4bcf-863a-dc4400c55b0e", "tag": "d80795fb-c4c0-43dc-ae59-5ec1a0711341"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:25:02.981655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:02.982153 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:02.982661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:02.996485 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] Creating event network-changed:d80795fb-c4c0-43dc-ae59-5ec1a0711341 for instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e on hv-cinder-85697 Sep 15 14:25:03.002277 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-e821318e-2c4a-4f0b-8847-d3ba0f5bb2cd req-b630d97f-03fa-46c3-961c-ab5eebdae8f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040212 Sep 15 14:25:03.006209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 604/1187] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:25:03.147436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:25:03.148080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:25:03.154879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:03.155366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:03.155829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:03.156533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:25:03.156984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:25:03.157464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:25:03.288717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:25:03.296625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9a9105a8-58ea-4c20-956e-c7a49c563411 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1563 microversion: 2.1 time: 0.153166 Sep 15 14:25:03.298671 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 584/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:25:03 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:18.814989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=11 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:18.815741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=92 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:18.820913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:18.821491 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:18.829336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:18.829816 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:18.830246 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:18.830930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:18.831386 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:18.831836 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:18.856633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-1a444d5a-cd28-4f08-8ba1-a3d7dfa509d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/ips" status: 200 len: 150 microversion: 2.1 time: 0.044704 Sep 15 14:26:18.857192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 605/1189] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:26:18 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:20.187984 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=13 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:20.188712 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=22 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:20.189581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:26:20.189730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:26:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments (ip 10.222.0.27) !!! Sep 15 14:26:20.195478 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b30f3c86-1467-4ef2-a485-d1c3447680c7"}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:20.197870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:20.206848 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:20.207328 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:20.207796 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:20.208480 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:20.208930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:20.209352 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:20.471159 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb22afba-e7ee-4f04-b890-cfff43dc0d61 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285300 Sep 15 14:26:20.471939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 585/1190] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:26:20 2022] POST /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:28.095392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b30f3c86-1467-4ef2-a485-d1c3447680c7"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:28.097797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:28.104136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.104615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.105052 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.105743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.106192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.106614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.183917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: POST /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments HTTP/1.1 Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 74 Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:26:28.185633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {"volumeAttachment": {"volumeId": "b30f3c86-1467-4ef2-a485-d1c3447680c7"}} Sep 15 14:26:28.187372 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'server_id': '77c39a84-6cce-4bcf-863a-dc4400c55b0e', 'body': {'volumeAttachment': {'volumeId': 'b30f3c86-1467-4ef2-a485-d1c3447680c7'}}} Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:28.189349 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:28.190884 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 400 to user: Invalid volume: volume b30f3c86-1467-4ef2-a485-d1c3447680c7 is already attached to instances: 77c39a84-6cce-4bcf-863a-dc4400c55b0e {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7f0bad36-59e8-443a-affd-fbc002250142 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095793 Sep 15 14:26:28.192473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 606/1191] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:26:28 2022] POST /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 14:26:28.256935 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:28.257532 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:28.263680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.264178 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.264627 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.265302 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.265742 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.266155 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.347973 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lazy-loading 'services' on Instance uuid 77c39a84-6cce-4bcf-863a-dc4400c55b0e {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:26:28.592519 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-20f4fc61-dbfe-4679-821f-3f8fbcc066f6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments/b30f3c86-1467-4ef2-a485-d1c3447680c7" status: 202 len: 0 microversion: 2.1 time: 0.340157 Sep 15 14:26:28.593125 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 586/1192] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:26:28 2022] DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments/b30f3c86-1467-4ef2-a485-d1c3447680c7 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:26:28.601784 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:28.604061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:28.610248 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.610810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.611343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.612033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:28.612869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:28.613291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:28.647146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8a8ab09e-18d3-4196-a574-562c7ac22582 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049351 Sep 15 14:26:28.647728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 607/1193] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:26:28 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:29.661873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:29.664197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:29.670285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.670758 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.671185 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:29.671899 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.672346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.672975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:29.701500 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-28e3871e-ce88-4645-9384-5d3fb71a8d1d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045402 Sep 15 14:26:29.702047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 587/1194] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:26:29 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:26:29.764486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:29.764989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:29.771994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.772480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.772921 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:29.773615 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.774074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.774501 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:29.799533 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:26:29.873831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-145a7f35-3dcf-4d0e-8562-40b5ed786904 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 204 len: 0 microversion: 2.1 time: 0.112887 Sep 15 14:26:29.874561 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 608/1195] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:26:29 2022] DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:26:29.883198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:29.883858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:29.889803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.890284 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.890721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:29.892110 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:29.892577 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:29.893004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:30.027099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:30.035388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-bb21fcae-533b-4f0f-82c1-95270fc68df2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1682 microversion: 2.1 time: 0.156101 Sep 15 14:26:30.035989 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 588/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:29 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:31.060162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:31.060895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:31.067637 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:31.068171 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:31.068592 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:31.069284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:31.069739 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:31.070432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:31.201294 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:31.209461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0fc5fcff-e7bc-42ac-86b8-1c484737ee12 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1682 microversion: 2.1 time: 0.153513 Sep 15 14:26:31.210058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 609/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:31 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:32.232799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:32.233368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:32.240004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:32.240487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:32.240917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:32.241631 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:32.242080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:32.242499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:32.425315 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:32.432932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ffe54fc0-2555-47d4-942d-fb105620c146 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1682 microversion: 2.1 time: 0.204076 Sep 15 14:26:32.433686 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 589/1198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:32 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:33.156734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c39a84-6cce-4bcf-863a-dc4400c55b0e", "name": "network-vif-deleted", "tag": "d80795fb-c4c0-43dc-ae59-5ec1a0711341"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:33.169862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:33.170393 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:33.171114 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:33.184350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] Creating event network-vif-deleted:d80795fb-c4c0-43dc-ae59-5ec1a0711341 for instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e on hv-cinder-85697 Sep 15 14:26:33.190329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-28608e6e-c811-4663-afc7-71cdd083f927 req-f2f7109f-3c92-4e20-97cc-5476a7bade9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111666 Sep 15 14:26:33.191259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 610/1199] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:33.457273 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:33.457872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:33.464236 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:33.464730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:33.465163 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:33.465907 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:33.466356 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:33.466768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:33.499883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:33.500101 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:33.500558 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:33.501800 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lazy-loading 'fault' on Instance uuid 77c39a84-6cce-4bcf-863a-dc4400c55b0e {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:26:33.553167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:33.561443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e2250a03-ec2d-4de2-8bdd-47bd3a852c65 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 200 len: 1331 microversion: 2.1 time: 0.108344 Sep 15 14:26:33.562010 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 590/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:33 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:34.587396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:34.588116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:34.594797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:34.595272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:34.595734 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:34.596426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:34.596877 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:34.597301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:34.610278 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e HTTP/1.1 Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:26:34.611908 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:26:34.613398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '77c39a84-6cce-4bcf-863a-dc4400c55b0e'} Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:26:34.614379 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:26:34.616091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:26:34.617614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:26:34.617614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-72e0505c-04bd-434f-acaf-9329bc51ca90 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 404 len: 111 microversion: 2.1 time: 0.030147 Sep 15 14:26:34.617614 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 611/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:34 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:26:34.622019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-da23ff52-28c3-49da-b34c-9eb2d4e6d8da tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '.version_select at 0x7fab47955940>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:34.644487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-da23ff52-28c3-49da-b34c-9eb2d4e6d8da tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455164408" status: 202 len: 0 microversion: 2.1 time: 0.026182 Sep 15 14:26:34.645046 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 591/1202] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 15 14:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455164408 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:26:35.259192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3b06273a-d539-4bcd-8ef7-45b1cb713060 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: .version_select at 0x7fab479f5e50>, body: {"keypair": {"name": "tempest-keypair-2136952536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWJFL9/ONMlD3GMaEjvrg0E8k23dOI3YF5jW+S83v7TAYP/XMlMV0MBVptosRBjwdgF8UAAxpXz4oc8608BVH49NS+M4djYS9fj9E033ZNBQg68eXV3MrWwd7p6AOImWA=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:35.274442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-3b06273a-d539-4bcd-8ef7-45b1cb713060 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:26:35.278146 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-3b06273a-d539-4bcd-8ef7-45b1cb713060 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:26:35.300063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3b06273a-d539-4bcd-8ef7-45b1cb713060 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044906 Sep 15 14:26:35.300640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 612/1203] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:26:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:36.505226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287113060", "imageRef": "e996d2f7-818f-4a0a-b906-994137cadaeb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48608c61-4597-4efa-9ed7-e6d47fa23e1a"}], "security_groups": [{"name": "tempest-securitygroup--1517748767"}], "key_name": "tempest-keypair-2136952536", "user_data": "}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:36.608091 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] validate_networks() for [('48608c61-4597-4efa-9ed7-e6d47fa23e1a', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:26:36.974543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:26:36.974965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:26:36.975433 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:26:36.975895 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:26:36.976312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:26:36.985294 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:36.985769 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:36.986717 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:36.987445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:36.987932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:36.988362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:37.005897 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:26:37.010024 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Getting quotas for user 37aa36608fc94226be02046ed4bbaf35 and project d1c7aba744814c7ca12a1dab68e1815a. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:26:37.021171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:26:37.023431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e996d2f7-818f-4a0a-b906-994137cadaeb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:26:37.071027 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-cce00365-bf57-45dc-b57e-16c1f1b939cd tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571604 Sep 15 14:26:37.071873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 592/1204] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:26:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 14:26:37.083414 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-80ea62b7-4a0c-4198-8678-d62d841e8cc7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:37.084067 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-80ea62b7-4a0c-4198-8678-d62d841e8cc7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:37.142722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-80ea62b7-4a0c-4198-8678-d62d841e8cc7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:37.149993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-80ea62b7-4a0c-4198-8678-d62d841e8cc7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1241 microversion: 2.1 time: 0.071007 Sep 15 14:26:37.150551 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 613/1205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:37 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:38.174423 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:38.175095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:38.181750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:38.182239 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:38.182669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:38.183560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:38.184198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:38.184789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:38.255094 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:38.263165 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-93c8ac13-5d99-416f-8b94-f85e04d4bb15 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1301 microversion: 2.1 time: 0.093832 Sep 15 14:26:38.263957 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 593/1206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:38 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:39.288582 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:39.290434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:39.307004 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:39.307841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:39.308458 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:39.309350 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:39.316318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:39.317651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:39.508611 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:39.518264 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-c61da753-8dff-40bf-b802-bad5b1cc0cef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.235582 Sep 15 14:26:39.519038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 614/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:39 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:39.738259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a309ac-2b80-4a70-8143-9748049d6b45", "tag": "c64b4452-502b-4892-bae4-d45619e346f9"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:39.754290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:39.755099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:39.755541 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:39.767474 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] Creating event network-changed:c64b4452-502b-4892-bae4-d45619e346f9 for instance 80a309ac-2b80-4a70-8143-9748049d6b45 on hv-cinder-85697 Sep 15 14:26:39.772560 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-79f17a08-16a5-4a7a-837c-350b402fe1f7 req-801bb41e-92d4-4cfd-bd31-a7e061714f84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038658 Sep 15 14:26:39.773164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 594/1208] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:40.012764 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:40.013344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:40.016273 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:40.020253 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.021471 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.023132 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.024204 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.024932 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.025521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.026437 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.027227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.027887 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.043229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] Creating event network-changed:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:26:40.052319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-25b5e357-7ebc-46c1-b67d-e201798a9be0 req-7249494d-0948-4e2d-9197-c4e092c4374c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039793 Sep 15 14:26:40.056581 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 595/1209] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:26:40.059805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:26:40.164351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-60f2804f-2983-43b1-85bc-c553d3bfcbf0 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 204 len: 0 microversion: 2.1 time: 0.155057 Sep 15 14:26:40.175786 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 615/1210] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:26:40 2022] DELETE /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:26:40.175987 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:40.176685 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:40.182846 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.183324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.183782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.184664 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.185112 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.185718 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.322264 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:40.331358 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-22fa6300-90e4-4d3e-92bf-9038ef80ad23 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.160112 Sep 15 14:26:40.332057 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 596/1211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:40 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:40.542789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:40.543475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:40.550462 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.550938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.551365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.552086 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:40.552552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:40.552950 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:40.683706 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:40.692556 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-013ed6ae-2873-4c2e-9bd6-1dd9c34188b2 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.153896 Sep 15 14:26:40.693145 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 616/1212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:40 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:41.354764 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:41.355504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:41.362047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:41.362518 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:41.362941 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:41.363617 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:41.364085 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:41.364499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:41.497656 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:41.505381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5050b076-bca3-40b2-b6d1-8fe2f2c9a051 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.154473 Sep 15 14:26:41.505948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 597/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:41 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:41.716383 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:41.716989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:41.722993 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:41.723475 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:41.723945 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:41.724633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:41.725088 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:41.725512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:41.853906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:41.863469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a46f95f2-b62c-4365-8a98-938d7537ceeb tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.150787 Sep 15 14:26:41.864547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 617/1214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:41 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:42.528743 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:42.529360 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:42.536493 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:42.536968 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:42.537396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:42.538079 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:42.538529 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:42.538947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:42.667197 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:42.675463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f7ddd2b5-d35b-43d4-b444-10e74931e2ff tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.150673 Sep 15 14:26:42.676063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 598/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:42 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:42.887398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:42.888057 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:42.894355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:42.894841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:42.895284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:42.896020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:42.896480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:42.896907 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:43.028869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:43.037092 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-800ea873-776f-441d-82f1-4610cc3f8aea tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.153632 Sep 15 14:26:43.037663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 618/1216] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:42 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:43.698531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:43.699148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:43.707421 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:43.708855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:43.709566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:43.711314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:43.712942 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:43.714419 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:43.918707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:43.927614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4f8f39b3-6f2c-491c-b78d-639571a6135d tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1569 microversion: 2.1 time: 0.233117 Sep 15 14:26:43.928461 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 599/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:43 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:44.060578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:44.061219 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:44.068480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.068975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.069411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.070559 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.071018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.071473 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.370519 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:44.378275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b668994b-3ad7-4aa0-8b57-e5143612c5ef tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.321885 Sep 15 14:26:44.378971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 619/1218] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:44 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:44.544574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e863a8-235f-45ee-a47a-2deabd16ad2a", "name": "network-vif-deleted", "tag": "92a00c0d-2475-4939-b1bd-39d65c68f258"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:44.554755 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.555229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.555660 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.567298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] Creating event network-vif-deleted:92a00c0d-2475-4939-b1bd-39d65c68f258 for instance 62e863a8-235f-45ee-a47a-2deabd16ad2a on hv-cinder-85697 Sep 15 14:26:44.573138 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-9bc46a9b-46d9-43c0-8fae-65150e1c58da req-bf317b89-5ccf-4190-854c-19226efb66a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Sep 15 14:26:44.573853 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 600/1219] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:44.950798 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:44.951508 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:44.960481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.961090 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.961725 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.962683 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.963140 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.963600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.996324 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:44.996809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:44.997578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:44.998033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.objects.instance [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lazy-loading 'fault' on Instance uuid 62e863a8-235f-45ee-a47a-2deabd16ad2a {{(pid=120647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:26:45.041810 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177058e8e42244faabca6c572a581428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3280b84c87ee422c986300291186a41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:45.050084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-157b1a06-2e5c-46c3-a714-c3925da97a20 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 200 len: 1225 microversion: 2.1 time: 0.103337 Sep 15 14:26:45.050862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 620/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:44 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:45.402597 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:45.403298 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:45.411011 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:45.411505 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:45.411956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:45.412648 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:45.413096 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:45.413511 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:45.554527 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:45.562153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d8452ff7-a2d8-44f5-9bef-bd80bdfe98ed tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.164909 Sep 15 14:26:45.562714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 601/1221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:45 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:45.821079 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a309ac-2b80-4a70-8143-9748049d6b45", "name": "network-vif-plugged", "status": "completed", "tag": "c64b4452-502b-4892-bae4-d45619e346f9"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:45.831138 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:45.831619 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:45.832074 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:45.843076 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] Creating event network-vif-plugged:c64b4452-502b-4892-bae4-d45619e346f9 for instance 80a309ac-2b80-4a70-8143-9748049d6b45 on hv-cinder-85697 Sep 15 14:26:45.848179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-3aa2e309-9ffd-4038-b9fc-bdd3c94f3d1e req-ab58dd6e-2b72-497a-bc1a-ebf86d2a0683 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081465 Sep 15 14:26:45.848783 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 621/1222] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:26:46.074496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:46.075120 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] [instance: 62e863a8-235f-45ee-a47a-2deabd16ad2a] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:46.081171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:46.082277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:46.082716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:46.083424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:46.083916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:46.084352 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:46.098495 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] HTTP exception thrown: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Request method failure captured: Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a HTTP/1.1 Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjgSGR6DqUFrGLlOld6bIaD5U3DlytNgIrqzI_ZtbgdcLZXXx0-PK2mPYkVb3GWuMFGxE1C71vyI9PTBGYuvbNzb134qg9VSxjxV3E-WQ9J4ow6QB1BC1Qz6jNbaBT1vWKwdO6TK0rmAKPOipBYMjfET1jJoGsLRWiNjWSfiixQoY Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: 3280b84c87ee422c986300291186a41d Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestShelveInstance-1762387485 Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:26:46.100164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3280b84c87ee422c986300291186a41d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3280b84c87ee422c986300291186a41d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3280b84c87ee422c986300291186a41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3280b84c87ee422c986300291186a41d"}]}] Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestShelveInstance-1762387485 Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: 3280b84c87ee422c986300291186a41d Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestShelveInstance-1762387485 Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-TestShelveInstance-1762387485-project Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 177058e8e42244faabca6c572a581428 Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestShelveInstance-1762387485-project Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. Sep 15 14:26:46.101731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '62e863a8-235f-45ee-a47a-2deabd16ad2a'} Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:26:46.102586 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. Sep 15 14:26:46.103982 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:26:46.105203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Returning 404 to user: Instance 62e863a8-235f-45ee-a47a-2deabd16ad2a could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:26:46.105203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4b2604bb-6d08-437f-95ac-6c5547856460 tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a" status: 404 len: 111 microversion: 2.1 time: 0.031275 Sep 15 14:26:46.105203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 602/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:46 2022] GET /compute/v2.1/servers/62e863a8-235f-45ee-a47a-2deabd16ad2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:26:46.258436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-248092dd-af7e-4119-acbf-791cd3c68acc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] Calling method '.version_select at 0x7fab47af44c0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:46.284083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-248092dd-af7e-4119-acbf-791cd3c68acc tempest-TestShelveInstance-1762387485 tempest-TestShelveInstance-1762387485-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1009678115" status: 202 len: 0 microversion: 2.1 time: 0.028542 Sep 15 14:26:46.284931 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 622/1224] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 15 14:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1009678115 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 14:26:46.585801 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:46.586415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:46.592869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:46.593352 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:46.593777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:46.594459 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:46.594900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:46.597819 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:46.620677 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:46.743649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:46.751457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b38b1fa8-bd5a-4d77-bddb-1396a0aab976 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.169577 Sep 15 14:26:46.752773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 603/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:46 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:47.773583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=6 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:47.777579 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:47.778312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:47.785831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:47.786327 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:47.786777 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:47.787488 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:47.787968 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:47.788393 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:47.792694 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:47.994965 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:48.002732 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e3ba2021-595d-4058-bc54-b49828dbbe24 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1367 microversion: 2.1 time: 0.230459 Sep 15 14:26:48.003318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 623/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:47 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:49.025732 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:49.026349 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:49.029229 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:49.029890 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:49.035182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:49.035665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:49.036123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:49.036817 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:49.037267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:49.037690 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:49.179146 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:26:49.187873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a56f69b2-eebb-4a4f-b720-1d9ecff63c3d tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1557 microversion: 2.1 time: 0.166070 Sep 15 14:26:49.188457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 604/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:26:49 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:26:49.211797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:26:49.212371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:26:49.214709 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:49.219917 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:49.220976 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:49.221597 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:49.222318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:49.222782 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:49.223211 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:49.365913 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-de0c8c6f-3247-4b61-b659-57b9de3a8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158594 Sep 15 14:26:49.366979 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 624/1228] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 15 14:26:49 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:26:50.670862 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a309ac-2b80-4a70-8143-9748049d6b45", "tag": "c64b4452-502b-4892-bae4-d45619e346f9"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:26:50.677849 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:26:50.683857 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:26:50.684346 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:26:50.684771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:26:50.705106 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] Creating event network-changed:c64b4452-502b-4892-bae4-d45619e346f9 for instance 80a309ac-2b80-4a70-8143-9748049d6b45 on hv-cinder-85697 Sep 15 14:26:50.710366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-291fc201-707d-4b02-b697-1b027ec0fed2 req-a29c695e-de00-444e-b797-f838757882c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043823 Sep 15 14:26:50.710965 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 605/1229] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:27:03.919909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=8 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:03.920633 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:04.093399 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-16863bff-2b43-4e25-ad46-d4dc2545d947 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Action: 'create', calling method: .version_select at 0x7fab47b270d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-723296571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAigRMZ9hLXc9YX+lD06KY9w28b0cebVb4V2HVyB4tKG5KaehKvLg5G3q8U1lVIt6H7lqmkj1fKFi6lVlp5yh13v9OVwlaHTb7vbGWJM1uPHdJ6jir0pYhGZp+h5K1PvSw=="}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:27:04.110791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-16863bff-2b43-4e25-ad46-d4dc2545d947 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:27:04.115673 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.quota [None req-16863bff-2b43-4e25-ad46-d4dc2545d947 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for user 1c072306d6534925b92fbc5ef01aaaf6 and project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'key_pairs'} {{(pid=120647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:27:04.142318 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-16863bff-2b43-4e25-ad46-d4dc2545d947 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.223754 Sep 15 14:27:04.142975 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 625/1230] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 15 14:27:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:27:25.684689 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=10 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:25.688836 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1660269936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-723296571", "security_groups": [{"name": "tempest-secgroup-smoke-1521721999"}], "block_device_mapping_v2": [{"uuid": "ca408b2c-4b38-429d-b508-6c09d87a5aee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:27:25.799804 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] validate_networks() for [('f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:27:26.249906 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:27:26.250332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:27:26.250798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:27:26.251200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:27:26.251604 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:27:26.260678 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:26.261152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:26.261579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:26.262292 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:26.262737 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:26.263153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:26.280026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:27:26.283905 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for user 1c072306d6534925b92fbc5ef01aaaf6 and project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:27:26.341788 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:27:26.344034 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca408b2c-4b38-429d-b508-6c09d87a5aee',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:27:26.470002 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a575ec23-808e-45cc-81f9-1c3c17d87bb4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787164 Sep 15 14:27:26.470647 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 606/1231] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:27:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:27:26.482426 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-dfa2722d-6473-4916-b305-371be327b8b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:26.483037 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-dfa2722d-6473-4916-b305-371be327b8b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:26.485845 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=4 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:26.486479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:26.542581 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-dfa2722d-6473-4916-b305-371be327b8b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:26.549423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-dfa2722d-6473-4916-b305-371be327b8b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1094 microversion: 2.1 time: 0.070941 Sep 15 14:27:26.550023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 626/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:26 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:27.573082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:27.573641 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:27.581282 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:27.581780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:27.582217 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:27.582919 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:27.583375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:27.583828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:27.647763 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:27.655790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-b63ceec0-1d14-4115-9ec9-5212e9033678 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1200 microversion: 2.1 time: 0.087370 Sep 15 14:27:27.656552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 607/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:27 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:28.681267 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:28.681909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:28.689601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:28.690083 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:28.690521 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:28.693261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:28.693261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:28.693261 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:28.924121 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:28.932354 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6025cb3b-7110-4785-8295-095c8cbc128d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.254833 Sep 15 14:27:28.932892 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 627/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:28 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:27:29.140553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa929a-8671-4b84-a300-dee26b8dfa02", "tag": "812a62e2-da15-4a46-b6f8-cb419b29755f"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:27:29.150314 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:29.150791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:29.151221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:29.162869 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] Creating event network-changed:812a62e2-da15-4a46-b6f8-cb419b29755f for instance 6afa929a-8671-4b84-a300-dee26b8dfa02 on hv-cinder-85697 Sep 15 14:27:29.167833 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-1cf9a6dd-7439-40ae-96cd-f8aa569e2be3 req-cef6eb5a-98f4-4ffe-8295-aa6d903fff6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095681 Sep 15 14:27:29.168431 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 608/1235] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:27:29.955202 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:29.955829 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:29.962436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:29.962910 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:29.963340 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:29.964061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:29.964509 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:29.964929 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:30.102210 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:30.109771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-bdb814ee-12f8-4239-80ad-5ff5a695120b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.158442 Sep 15 14:27:30.110332 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 628/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:29 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:31.134203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:31.134829 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:31.140944 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:31.141415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:31.141837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:31.142515 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:31.142958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:31.143476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:31.276940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:31.284543 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c414a825-4683-4a4d-9985-c64025728af0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.155694 Sep 15 14:27:31.285102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 609/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:31 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:32.307750 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:32.308288 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:32.314692 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:32.315177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:32.315616 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:32.316332 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:32.317287 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:32.317724 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:32.446608 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:32.454363 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b7ed6cbf-e6b7-4905-9e28-a0d8f22a30ef tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.150619 Sep 15 14:27:32.454994 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 629/1238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:32 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:33.478004 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:33.478615 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:33.484986 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:33.485464 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:33.485888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:33.486572 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:33.487016 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:33.487429 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:33.635490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:33.643152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3df45818-057b-4578-bc0c-e6322cc05757 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.169189 Sep 15 14:27:33.643738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 610/1239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:33 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:34.666429 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:34.667002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:34.673286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:34.673758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:34.674188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:34.674867 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:34.675313 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:34.675763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:34.803791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:34.811402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-60b19a2a-65e5-4f4e-834e-bc7cd13a90b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.148984 Sep 15 14:27:34.812011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 630/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:34 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:35.834152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:35.834794 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:35.841293 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:35.841766 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:35.842191 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:35.842867 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:35.843311 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:35.843751 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:35.975151 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:35.982707 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-80efd004-220a-40e5-abb1-e40ad06db865 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.152714 Sep 15 14:27:35.983272 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 611/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:35 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:37.005826 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:37.006431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:37.008775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:37.014181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:37.014663 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:37.015101 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:37.015820 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:37.016275 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:37.016699 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:37.149208 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:37.156825 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3160dabf-149e-475e-8a49-c24688cf2275 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.154853 Sep 15 14:27:37.157394 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 631/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:37 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:38.179773 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:38.180333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:38.182468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:38.183260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:27:38.189553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:38.190020 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:38.190443 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:38.191119 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:38.192099 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:38.192520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:38.327420 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:38.335247 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-5154efd7-73af-42db-a863-c126617aa2cd tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.159498 Sep 15 14:27:38.335839 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 612/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:38 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:39.358435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:39.359049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:39.366421 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:39.366911 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:39.367351 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:39.368089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:39.368575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:39.369005 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:39.500896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:39.508576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-2978bf37-7db1-4864-a999-4eff26821df4 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.154024 Sep 15 14:27:39.509143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 632/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:39 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:39.979052 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa929a-8671-4b84-a300-dee26b8dfa02", "name": "network-vif-plugged", "status": "completed", "tag": "812a62e2-da15-4a46-b6f8-cb419b29755f"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:27:39.988983 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:39.989462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:39.989879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:40.001399 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] Creating event network-vif-plugged:812a62e2-da15-4a46-b6f8-cb419b29755f for instance 6afa929a-8671-4b84-a300-dee26b8dfa02 on hv-cinder-85697 Sep 15 14:27:40.006657 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-c6fea07f-11c6-4cfb-b1ef-ad161306d3f8 req-31941daf-dad8-4d86-8c83-b80d84522692 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Sep 15 14:27:40.007259 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 613/1245] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:27:40.530461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:40.531041 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:40.537535 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:40.538015 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:40.538450 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:40.539135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:40.539586 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:40.540031 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:40.670983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:40.679116 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-309e22f9-08ee-4af9-9c43-4e1ab44eefc5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.152561 Sep 15 14:27:40.679705 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 633/1246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:40 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:41.703361 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:41.704008 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:41.710171 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:41.710649 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:41.711081 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:41.711793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:41.712245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:41.712665 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:41.844300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:41.852174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-98141a20-a7c1-4778-8507-ec46e097f159 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1266 microversion: 2.1 time: 0.153629 Sep 15 14:27:41.852738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 614/1247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:41 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:42.875058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:42.875677 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:42.882080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:42.882554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:42.883376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:42.883653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:42.884198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:42.884660 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:43.016671 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:43.025195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-38ba6b4c-ebd5-4537-ae0c-2463321a7636 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1454 microversion: 2.1 time: 0.154258 Sep 15 14:27:43.025755 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 634/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:42 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:43.047490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:27:43.048167 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:27:43.054692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:43.055170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:43.055603 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:43.056330 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:43.056782 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:43.057204 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:43.195978 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:27:43.203563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2db2d71d-db32-4b9f-a4cd-19cb5f68f046 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1454 microversion: 2.1 time: 0.159896 Sep 15 14:27:43.204168 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 615/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:27:43 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:27:45.075259 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa929a-8671-4b84-a300-dee26b8dfa02", "tag": "812a62e2-da15-4a46-b6f8-cb419b29755f"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:27:45.085191 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:27:45.085662 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:27:45.086084 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:27:45.097670 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] Creating event network-changed:812a62e2-da15-4a46-b6f8-cb419b29755f for instance 6afa929a-8671-4b84-a300-dee26b8dfa02 on hv-cinder-85697 Sep 15 14:27:45.103966 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-baaba52b-e096-4b03-9c91-4bbcf97b6382 req-70a51c64-ee84-4fb6-ba3a-f5015e4457a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Sep 15 14:27:45.104728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 635/1250] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:28:05.743639 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:05.744268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:05.746768 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:28:05.747430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=48 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:28:05.753790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:05.754275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:05.754709 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:05.755408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:05.756428 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:05.756911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:05.780791 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-560ee8a9-535d-4242-a0b4-24c7e5af5ea6 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/ips" status: 200 len: 150 microversion: 2.1 time: 0.041073 Sep 15 14:28:05.781359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 616/1251] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 15 14:28:05 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:28:07.109157 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bceaf5a-66e3-4aff-a75c-e60d7fa382da"}} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:28:07.111629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:07.114193 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=22 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:28:07.114841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=50 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:28:07.121803 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:07.122286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:07.122722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:07.123415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:07.123928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:07.124355 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:07.384771 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e7c335d5-91d6-406e-a390-8f59f9c22fc3 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "POST /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279749 Sep 15 14:28:07.385377 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 636/1252] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 15 14:28:07 2022] POST /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:28:15.020381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:15.020932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:15.028809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:15.029462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:15.030093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:15.031158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:15.031614 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:15.032061 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:15.113566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.objects.instance [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lazy-loading 'services' on Instance uuid 80a309ac-2b80-4a70-8143-9748049d6b45 {{(pid=120648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 14:28:15.184968 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-2d314d8e-701a-456d-a6f1-2f1b9aac5037 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments/8bceaf5a-66e3-4aff-a75c-e60d7fa382da" status: 202 len: 0 microversion: 2.1 time: 0.168485 Sep 15 14:28:15.185799 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 617/1253] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 15 14:28:15 2022] DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments/8bceaf5a-66e3-4aff-a75c-e60d7fa382da => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:28:15.196583 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:15.198935 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:15.205607 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:15.206058 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:15.206499 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:15.207203 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:15.207655 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:15.208135 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:15.237843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-5d9fa7b1-4812-428c-9b4f-19412f5425e0 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047560 Sep 15 14:28:15.238402 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 637/1254] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:28:15 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:28:16.252048 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:16.254396 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:16.261241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.261653 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.262080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.262757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.263203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.263616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.292967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a4cba4a1-19dd-453d-a069-01dd565ef8a7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046201 Sep 15 14:28:16.293520 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 618/1255] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 15 14:28:16 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 14:28:16.358328 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:16.358805 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:16.365195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.365856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.366297 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.366983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.367434 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.367889 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.393136 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Going to try to terminate instance {{(pid=120647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:28:16.466089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-49eee2b9-a197-4fcb-a7bc-a196a4420978 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 204 len: 0 microversion: 2.1 time: 0.111119 Sep 15 14:28:16.466495 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 638/1256] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:28:16 2022] DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:28:16.475035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:16.475650 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:16.481566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.482047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.482501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.483174 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:16.483630 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:16.484077 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:16.616826 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:28:16.624494 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-ce07a544-99d8-4d95-853d-9346d9f508d7 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1682 microversion: 2.1 time: 0.153381 Sep 15 14:28:16.625068 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 619/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:16 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:28:17.648768 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:17.649376 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:17.655824 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:17.656322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:17.656752 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:17.657427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:17.657874 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:17.658291 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:17.787797 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:28:17.795443 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d9885b3e-a752-46c8-9b64-c5002c61c227 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1682 microversion: 2.1 time: 0.151202 Sep 15 14:28:17.796072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 639/1258] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:17 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:28:18.819462 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:18.820137 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:18.826780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:18.827256 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:18.827697 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:18.828391 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:18.828838 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:18.829253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:18.964018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37aa36608fc94226be02046ed4bbaf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c7aba744814c7ca12a1dab68e1815a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:28:18.972026 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-96b94143-efb7-4dff-999c-f50ff83bf0c1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 200 len: 1682 microversion: 2.1 time: 0.156375 Sep 15 14:28:18.972811 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 620/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:18 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:28:19.397371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a309ac-2b80-4a70-8143-9748049d6b45", "name": "network-vif-deleted", "tag": "c64b4452-502b-4892-bae4-d45619e346f9"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:28:19.409936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:19.410408 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:19.410840 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:19.423649 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] Creating event network-vif-deleted:c64b4452-502b-4892-bae4-d45619e346f9 for instance 80a309ac-2b80-4a70-8143-9748049d6b45 on hv-cinder-85697 Sep 15 14:28:19.430430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-090a7a2f-c439-494d-98ce-45b0a144d29f req-189c1d9b-ed72-47c3-832d-d5890df6e45d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037263 Sep 15 14:28:19.431396 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 640/1260] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:28:19.997019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:19.998153 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:20.007415 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:20.008694 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:20.009549 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:20.010784 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:20.011487 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:20.012141 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:20.028594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 HTTP/1.1 Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:28:20.030260 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:20.032136 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '80a309ac-2b80-4a70-8143-9748049d6b45'} Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:20.033277 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:20.034757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:20.036472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:20.036472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-f1f63e53-e222-411b-81f2-46736a36e134 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 404 len: 111 microversion: 2.1 time: 0.039690 Sep 15 14:28:20.036472 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 621/1261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:19 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:20.046928 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-21cc9e28-fa24-406c-bbfd-0af2aac033a1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '.version_select at 0x7fab4b032dc0>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:20.067851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-21cc9e28-fa24-406c-bbfd-0af2aac033a1 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136952536" status: 202 len: 0 microversion: 2.1 time: 0.029678 Sep 15 14:28:20.068834 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 641/1262] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 15 14:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136952536 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 14:28:21.843454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:21.843969 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:21.850754 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:21.851226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:21.851652 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:21.852351 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:21.852793 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:21.853208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:21.866359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 HTTP/1.1 Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:28:21.867928 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.869667 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '80a309ac-2b80-4a70-8143-9748049d6b45'} Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:21.870820 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.872632 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.874246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:21.874246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-412ba2d2-f55f-463f-90a3-a5611f2d8e05 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 404 len: 111 microversion: 2.1 time: 0.029614 Sep 15 14:28:21.874246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 622/1263] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:28:21 2022] DELETE /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 14:28:21.879479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:21.880247 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 80a309ac-2b80-4a70-8143-9748049d6b45] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:21.887246 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:21.887790 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:21.888256 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:21.888934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:21.889392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:21.889822 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:21.903234 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 HTTP/1.1 Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:28:21.904858 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.906708 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '80a309ac-2b80-4a70-8143-9748049d6b45'} Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:21.907775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. Sep 15 14:28:21.909554 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:21.910989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 80a309ac-2b80-4a70-8143-9748049d6b45 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:21.910989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d6ea4f2b-b40a-4556-8a76-54068712bc48 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45" status: 404 len: 111 microversion: 2.1 time: 0.030613 Sep 15 14:28:21.910989 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 642/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:21 2022] GET /compute/v2.1/servers/80a309ac-2b80-4a70-8143-9748049d6b45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:23.046047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:23.046571 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:23.052884 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.053402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.053831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.054524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.054981 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.055405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.069413 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e HTTP/1.1 Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:28:23.071253 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.072970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '77c39a84-6cce-4bcf-863a-dc4400c55b0e'} Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:23.074032 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.075575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.077161 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:23.077161 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-92880512-25f0-4d5c-87aa-b3859571f806 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 404 len: 111 microversion: 2.1 time: 0.030995 Sep 15 14:28:23.077161 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 623/1265] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:28:23 2022] DELETE /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:23.081148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:23.081758 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: 77c39a84-6cce-4bcf-863a-dc4400c55b0e] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:23.089000 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.089480 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.089915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.090604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.091087 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.091510 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.104843 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e HTTP/1.1 Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:28:23.106416 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.108108 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '77c39a84-6cce-4bcf-863a-dc4400c55b0e'} Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:23.109329 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. Sep 15 14:28:23.110952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.112387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance 77c39a84-6cce-4bcf-863a-dc4400c55b0e could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:23.112387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7650a1b3-f513-4712-829c-21bd6f4270f9 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e" status: 404 len: 111 microversion: 2.1 time: 0.030520 Sep 15 14:28:23.112387 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 643/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:23 2022] GET /compute/v2.1/servers/77c39a84-6cce-4bcf-863a-dc4400c55b0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:23.116548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:23.117049 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:23.122916 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.123395 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.123861 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.124552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.125007 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.125430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.142332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 HTTP/1.1 Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:28:23.143939 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.145852 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'ac0daab3-8cb7-4360-a1e5-13476c70d800'} Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:23.147381 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.149246 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.150865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:23.150865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-1207b270-df65-40bf-ba4e-ef4d6ae39805 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 404 len: 111 microversion: 2.1 time: 0.032795 Sep 15 14:28:23.150865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 624/1267] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:28:23 2022] DELETE /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:23.154431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:23.155036 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: ac0daab3-8cb7-4360-a1e5-13476c70d800] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:23.160981 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.161460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.161895 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.162723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:23.163178 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:23.163601 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:23.176690 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 HTTP/1.1 Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:28:23.178412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.180188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'ac0daab3-8cb7-4360-a1e5-13476c70d800'} Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:23.181274 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. Sep 15 14:28:23.182906 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:23.184322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance ac0daab3-8cb7-4360-a1e5-13476c70d800 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:23.184322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-59a576bc-948d-48a7-ad3f-406b61382519 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800" status: 404 len: 111 microversion: 2.1 time: 0.029220 Sep 15 14:28:23.184322 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 644/1268] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:23 2022] GET /compute/v2.1/servers/ac0daab3-8cb7-4360-a1e5-13476c70d800 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:24.324977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:24.325471 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:24.331872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:24.332343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:24.332765 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:24.333442 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:24.333885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:24.334435 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:24.348070 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 HTTP/1.1 Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:28:24.349579 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.351454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': 'd1316954-2ee7-42c7-a914-f56173515086'} Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:24.352417 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.353761 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.355730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:24.355730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-302cf5a7-12cb-48d5-8dc5-950ba37a8259 tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 404 len: 111 microversion: 2.1 time: 0.030146 Sep 15 14:28:24.355730 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 625/1269] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:28:24 2022] DELETE /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:28:24.359321 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:28:24.359957 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] [instance: d1316954-2ee7-42c7-a914-f56173515086] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:28:24.366936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:24.367415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:24.367899 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:24.368600 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:28:24.369053 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:28:24.369476 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:28:24.383411 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] HTTP exception thrown: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Request method failure captured: Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 HTTP/1.1 Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzTjqaj3ve6Y9qBeZuixMkRGwDGUslSe-eLIwC_Dz2CIDjsBeGd_mT-28ietvW6ATJ4Q1LrA0qXgpuMZxfFHAm7tXQabNJio07Vy4-qh-87HJAp-mLLtoFxIx_zkwP8rrl6FcpI71HhNXz47LhSKWheharYT08Mjl0jusWiFTxMRpaA Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:28:24.384952 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1c7aba744814c7ca12a1dab68e1815a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1c7aba744814c7ca12a1dab68e1815a"}]}] Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: d1c7aba744814c7ca12a1dab68e1815a Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-442650959 Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 37aa36608fc94226be02046ed4bbaf35 Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-AttachVolumeNegativeTest-442650959-project Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.386707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'd1316954-2ee7-42c7-a914-f56173515086'} Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:28:24.387716 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. Sep 15 14:28:24.389365 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:28:24.390742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] Returning 404 to user: Instance d1316954-2ee7-42c7-a914-f56173515086 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:28:24.390742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-565dcb07-bcb2-425e-8b80-6da449845b6c tempest-AttachVolumeNegativeTest-442650959 tempest-AttachVolumeNegativeTest-442650959-project] 10.222.0.27 "GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086" status: 404 len: 111 microversion: 2.1 time: 0.030820 Sep 15 14:28:24.390742 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 645/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:28:24 2022] GET /compute/v2.1/servers/d1316954-2ee7-42c7-a914-f56173515086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:29:59.929278 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR oslo.messaging._drivers.impl_rabbit [-] [319da84a-e9b6-434e-85a4-8188465adf2e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 14:29:59.929885 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=20 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:29:59.930578 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:29:59.931724 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:29:59.931873 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 (ip 10.222.0.27) !!! Sep 15 14:29:59.933158 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:29:59.933306 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 (ip 10.222.0.27) !!! Sep 15 14:29:59.938725 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:29:59.939226 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:29:59.949100 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:29:59.949584 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:29:59.950017 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:29:59.950710 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:29:59.951170 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:29:59.951598 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:29:59.977990 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:30:00.052879 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-769cbabb-35dd-40b0-be15-ed79f42a8c6d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 204 len: 0 microversion: 2.1 time: 0.125681 Sep 15 14:30:00.053454 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 626/1271] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:29:59 2022] DELETE /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:30:00.059925 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:30:00.061564 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:30:00.063120 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:30:00.063296 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Thu Sep 15 14:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 (ip 10.222.0.27) !!! Sep 15 14:30:00.068113 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:00.068723 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:00.078531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:00.079016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:00.079453 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:00.080181 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:00.080640 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:00.081069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:00.398882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:00.406625 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a7dfc3a2-17a7-4510-b1db-1cd6850e6e0f tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1579 microversion: 2.1 time: 0.348654 Sep 15 14:30:00.407183 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 646/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:00 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1579 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:30:01.430333 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:01.431063 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:01.438855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:01.439341 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:01.439807 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:01.440506 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:01.440959 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:01.441383 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:01.447642 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] [319da84a-e9b6-434e-85a4-8188465adf2e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46880. Sep 15 14:30:01.630397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:01.638053 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9b245639-8a98-4ac1-910d-52fec1b8da5c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1579 microversion: 2.1 time: 0.211956 Sep 15 14:30:01.638548 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 627/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:01 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:02.661486 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:02.662081 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:02.668522 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:02.669016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:02.669465 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:02.670170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:02.670632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:02.671726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:02.742911 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa929a-8671-4b84-a300-dee26b8dfa02", "name": "network-vif-deleted", "tag": "812a62e2-da15-4a46-b6f8-cb419b29755f"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:30:02.758490 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:02.758971 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:02.759402 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:02.761445 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:02.771940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-49287622-bb99-4c64-a6a2-d4805a6763fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 200 len: 1511 microversion: 2.1 time: 0.113854 Sep 15 14:30:02.788080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 647/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:02 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 1511 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:02.789283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] Creating event network-vif-deleted:812a62e2-da15-4a46-b6f8-cb419b29755f for instance 6afa929a-8671-4b84-a300-dee26b8dfa02 on hv-cinder-85697 Sep 15 14:30:02.798920 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-ffd7bed7-1cef-4013-8612-cb393813cf9c req-2cb75dd8-348c-444f-82d6-6d555631e1bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063169 Sep 15 14:30:02.799777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 628/1275] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:30:03.796552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:03.797286 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:03.804161 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:03.804637 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:03.805069 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:03.805749 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:03.806198 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:03.806620 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:03.821930 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] HTTP exception thrown: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Request method failure captured: Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 HTTP/1.1 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzYyt-2j9415Dj248Yga2YEipkjolL1lHeNmJBwzo-7JBr4MElaIyTjUpSvG7whkJ4O1NgKWC6EOe9mvItuQdGGkMxFh_QQaYSXYKAvjvCTAAA5fMn-o_lY5pyhAFEz74hDkJoGzIeK2RgKvXDP-8t_Odum2a_0bVHLrghSBenQX8VQ Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:30:03.823896 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}] Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 1c072306d6534925b92fbc5ef01aaaf6 Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:30:03.825741 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '6afa929a-8671-4b84-a300-dee26b8dfa02'} Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:30:03.826802 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:30:03.829466 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:30:03.830971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Returning 404 to user: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:30:03.830971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-8eb6f13f-52b4-4487-a9e1-6125f402a28e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 404 len: 111 microversion: 2.1 time: 0.032840 Sep 15 14:30:03.830971 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 648/1276] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:03 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:30:03.918970 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1348436483", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-723296571", "security_groups": [{"name": "tempest-secgroup-smoke-1521721999"}], "block_device_mapping_v2": [{"uuid": "ca408b2c-4b38-429d-b508-6c09d87a5aee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:30:04.037803 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] validate_networks() for [('f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:30:04.688035 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:30:04.688463 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:30:04.688940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:30:04.689486 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:30:04.689903 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:30:04.699313 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:04.699828 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:04.700266 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:04.701014 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:04.701468 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:04.702451 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:04.721262 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:30:04.725245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for user 1c072306d6534925b92fbc5ef01aaaf6 and project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:30:04.781824 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:30:04.784064 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca408b2c-4b38-429d-b508-6c09d87a5aee',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:30:04.916675 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-35d13df5-1fb3-4f81-a701-f38a51649a41 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001768 Sep 15 14:30:04.917326 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 629/1277] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:30:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:30:04.929002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-7f9ef31e-bcab-4496-8905-2a1a1f64c347 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:04.929689 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-7f9ef31e-bcab-4496-8905-2a1a1f64c347 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:04.986773 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-7f9ef31e-bcab-4496-8905-2a1a1f64c347 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:04.993745 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-7f9ef31e-bcab-4496-8905-2a1a1f64c347 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1094 microversion: 2.1 time: 0.069095 Sep 15 14:30:04.994305 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 649/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:04 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:30:06.017196 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:06.017821 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:06.025400 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:06.025883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:06.026397 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:06.027177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:06.027524 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:06.028212 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:06.094757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:06.102509 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e4c17007-bbf1-48c4-ab95-07a337198521 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1210 microversion: 2.1 time: 0.090161 Sep 15 14:30:06.103082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 630/1279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:06 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:07.126611 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:07.127232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:07.137276 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:07.138023 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:07.138464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:07.139174 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:07.140173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:07.140609 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:07.360063 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:07.367775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3781d240-1f74-4485-9ba2-c54c1dbdae78 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.245105 Sep 15 14:30:07.368344 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 650/1280] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:07 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:07.496780 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6", "tag": "bce75eed-7428-4e92-b341-d6461658fadf"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:30:07.508721 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:07.509574 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:07.510067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:07.522552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] Creating event network-changed:bce75eed-7428-4e92-b341-d6461658fadf for instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 on hv-cinder-85697 Sep 15 14:30:07.528160 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-aa78d58c-0fde-4e0b-aad5-51e3d2981d77 req-f7a94202-f605-4c93-8e6a-38733be19d87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034864 Sep 15 14:30:07.528858 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 631/1281] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:30:08.390961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:08.391576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:08.398089 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:08.398575 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:08.399020 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:08.399730 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:08.400222 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:08.400651 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:08.534793 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:08.542468 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-9233bd35-ef7b-4b82-b685-e541dc29a2f0 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.155456 Sep 15 14:30:08.543012 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 651/1282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:08 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:09.566504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:09.567208 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:09.573870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:09.574353 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:09.574786 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:09.575476 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:09.576014 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:09.576440 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:09.706540 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:09.714378 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-41eddd4b-3464-4985-9ac1-50b23b20b257 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.153261 Sep 15 14:30:09.714958 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 632/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:09 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:10.737698 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:10.738432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:10.744953 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:10.745433 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:10.745871 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:10.746567 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:10.747019 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:10.747446 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:10.876469 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:10.884016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e8f17752-830d-4822-9277-3a02741b4a8c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.150718 Sep 15 14:30:10.884578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 652/1284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:10 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:11.909310 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:11.909870 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:11.916339 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:11.916818 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:11.917248 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:11.917940 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:11.918594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:11.919019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:12.051934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:12.059484 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d9eb44de-b81e-4c8c-9ee1-954d0d6f41b2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.157055 Sep 15 14:30:12.060095 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 633/1285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:11 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:13.082684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:13.083290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:13.089290 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:13.089762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:13.090188 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:13.090938 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:13.091384 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:13.091831 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:13.222769 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:13.230661 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-15b59418-04fa-47b0-ad29-b58471ab4be1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.151927 Sep 15 14:30:13.231218 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 653/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:13 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:14.253975 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:14.254611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:14.262513 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:14.262998 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:14.263433 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:14.264164 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:14.265189 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:14.265613 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:14.406594 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:14.414831 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-796f76ae-cc6b-4bdd-987f-c4f0477b9bfb tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.164347 Sep 15 14:30:14.415436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 634/1287] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:14 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:15.438460 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:15.439072 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:15.441412 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:30:15.447125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:15.447961 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:15.448400 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:15.449091 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:15.449552 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:15.449977 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:15.584791 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:15.592841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-145910ca-5670-4b7a-a5f6-667e9ab89683 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.158204 Sep 15 14:30:15.593407 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 654/1288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:15 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:16.615716 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:16.616268 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:16.618195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:30:16.618843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:30:16.624865 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:16.625354 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:16.625777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:16.626483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:16.626930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:16.627347 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:16.763466 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:16.771993 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-a6f4f26f-5375-4b80-bd90-a2ba9c3e8bb9 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.160311 Sep 15 14:30:16.772566 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 635/1289] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:16 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:17.795735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:17.796431 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:17.803479 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:17.803997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:17.804442 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:17.805159 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:17.805598 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:17.806030 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:17.934492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:17.942175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a7b0c6aa-551e-484c-91c7-0f220a3d9178 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.150389 Sep 15 14:30:17.942735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 655/1290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:17 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:18.891655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6", "name": "network-vif-plugged", "status": "completed", "tag": "bce75eed-7428-4e92-b341-d6461658fadf"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:30:18.901888 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:18.902375 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:18.902843 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:18.914374 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] Creating event network-vif-plugged:bce75eed-7428-4e92-b341-d6461658fadf for instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 on hv-cinder-85697 Sep 15 14:30:18.919405 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-90585b83-f6a6-43b1-aa2d-c70376e03833 req-fa434d8e-6af4-4409-8743-eaeb7eb934e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Sep 15 14:30:18.920076 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 636/1291] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:30:18.964728 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:18.965336 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:18.972260 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:18.972738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:18.973167 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:18.973856 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:18.974312 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:18.974751 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:19.119949 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:19.128050 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6ef7c533-ffd2-4d83-abcc-e82726af6941 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.167080 Sep 15 14:30:19.128629 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 656/1292] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:18 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:20.151430 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:20.152250 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:20.158866 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:20.159344 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:20.159809 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:20.160496 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:20.160947 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:20.161366 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:20.295813 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:20.304357 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4092b064-ea5a-4858-a96e-f055cb063e70 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1266 microversion: 2.1 time: 0.157589 Sep 15 14:30:20.304930 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 637/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:20 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:21.326570 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:21.327175 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:21.334292 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:21.334788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:21.335284 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:21.336196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:21.336735 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:21.337179 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:21.469809 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:21.477498 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b0c87e88-4950-443b-b3e9-6a494689dd0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1454 microversion: 2.1 time: 0.155019 Sep 15 14:30:21.478061 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 657/1294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:21 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:21.500611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:30:21.501207 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:30:21.507595 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:21.508177 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:21.508616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:21.509318 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:21.509777 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:21.510198 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:21.647093 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:30:21.654841 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-727525cb-a5b1-430e-a9bd-a0ee69cbc66b tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1454 microversion: 2.1 time: 0.158933 Sep 15 14:30:21.655404 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 638/1295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:30:21 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:30:23.256707 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6", "tag": "bce75eed-7428-4e92-b341-d6461658fadf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:30:23.267441 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:30:23.267951 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:30:23.268388 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:30:23.279239 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] Creating event network-changed:bce75eed-7428-4e92-b341-d6461658fadf for instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 on hv-cinder-85697 Sep 15 14:30:23.284557 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-ebc014be-690b-498d-b05f-4fa4882fa45d req-1737c3bf-b04f-4445-ba87-1d4b1f009792 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Sep 15 14:30:23.285166 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 658/1296] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:32:23.221872 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:23.222727 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:23.228213 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1996537071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-723296571", "security_groups": [{"name": "tempest-secgroup-smoke-1521721999"}], "block_device_mapping_v2": [{"uuid": "5cef4fdf-fa8f-4afa-83dc-1aa89e15c261", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc"}]}} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:32:23.343324 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.network.neutron [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] validate_networks() for [('f84d7d2b-66eb-4126-b7b1-ef497a7ac9fc', None, None, None, None, None)] {{(pid=120648) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 14:32:23.721031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 14:32:23.721483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image limits 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 14:32:23.721956 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Flavor pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 14:32:23.722362 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Image pref 0:0:0 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 14:32:23.722771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.virt.hardware [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 14:32:23.732179 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:23.732661 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:23.733097 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:23.733822 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:23.734304 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:23.734729 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:23.751972 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 14:32:23.755893 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.quota [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Getting quotas for user 1c072306d6534925b92fbc5ef01aaaf6 and project b9f4deb43acf410aa0a8e88c20ddb3f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 14:32:23.817187 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Going to run 1 instances... {{(pid=120648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 14:32:23.819376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cef4fdf-fa8f-4afa-83dc-1aa89e15c261',volume_size=None,volume_type=None)] {{(pid=120648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 14:32:23.947733 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-fa58b902-522f-4a90-ac73-3869a840bb84 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727614 Sep 15 14:32:23.948388 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 639/1297] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 15 14:32:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 14:32:23.957857 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8f10bed-fb40-4a1c-bd1f-c180bf9051a7] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 14:32:23.958461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=28 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:23.959398 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=64 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:23.960492 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:32:23.960684 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Thu Sep 15 14:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb (ip 10.222.0.27) !!! Sep 15 14:32:23.967461 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-86e80688-0a7d-4627-a63d-e63d8a0364e5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:23.968196 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-86e80688-0a7d-4627-a63d-e63d8a0364e5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:24.039452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-86e80688-0a7d-4627-a63d-e63d8a0364e5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:24.047016 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-86e80688-0a7d-4627-a63d-e63d8a0364e5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1094 microversion: 2.1 time: 0.091099 Sep 15 14:32:24.047578 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 659/1298] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:23 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:25.070134 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:25.070749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:25.077611 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:25.078087 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:25.078516 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:25.079221 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:25.079646 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:25.080422 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:25.147408 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:25.155186 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-e08e13e6-ff00-4876-b62a-74c616395bfe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1192 microversion: 2.1 time: 0.089740 Sep 15 14:32:25.156019 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 640/1299] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:25 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:26.178821 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:26.179423 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:26.190075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8f10bed-fb40-4a1c-bd1f-c180bf9051a7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47052. Sep 15 14:32:26.196624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:26.197119 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:26.197565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:26.198995 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:26.199736 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:26.200170 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:26.450158 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:26.457855 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b6b3e10a-45fe-49b1-aad4-bf903a4776f8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.283310 Sep 15 14:32:26.458424 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 660/1300] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:26 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:26.667576 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddde029b-85d9-4ae1-95d1-8c1bb06719bb", "tag": "766b2b63-af50-42c4-95de-01425c109bb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:32:26.678424 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:26.679267 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:26.679723 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:26.693663 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] Creating event network-changed:766b2b63-af50-42c4-95de-01425c109bb1 for instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb on hv-cinder-85697 Sep 15 14:32:26.698744 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-407e8f9a-773d-4bb1-b996-59443be1a19e req-465dab6f-b8b1-4151-a498-061c7e5a42ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035608 Sep 15 14:32:26.699622 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 641/1301] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 14:32:27.480859 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:27.481474 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:27.487936 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:27.488419 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:27.488854 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:27.489540 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:27.489992 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:27.490444 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:27.622657 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:27.630192 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-ae0ec4d2-38a9-4c26-b4fc-ffd33d49aee3 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.153482 Sep 15 14:32:27.630748 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 661/1302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:27 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:28.653517 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:28.654438 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:28.660934 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:28.661457 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:28.661917 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:28.662602 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:28.663067 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:28.663483 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:28.797692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:28.805544 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-0ce3b1f7-bfef-44d3-9704-5918a85b2ff1 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.156518 Sep 15 14:32:28.806113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 642/1303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:28 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:29.829110 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:29.829722 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:29.836127 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:29.836604 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:29.837038 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:29.837726 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:29.838177 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:29.839125 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:29.967343 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:29.975148 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-3387feeb-c318-4f18-ab1a-b2df92c3b4fe tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.149901 Sep 15 14:32:29.975789 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 662/1304] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:29 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:30.998228 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:30.999359 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:31.006216 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:31.006692 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:31.007124 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:31.007840 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:31.008290 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:31.008713 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:31.137148 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:31.144738 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d3f2506-e2c5-416e-8454-265b9a1f5a92 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.150539 Sep 15 14:32:31.145307 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 643/1305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:30 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:32.167232 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:32.167872 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:32.174279 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:32.174762 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:32.175205 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:32.175954 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:32.176415 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:32.176841 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:32.314837 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:32.322528 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b98c0a3b-487f-49a3-aea6-54b816fb6c5e tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.159234 Sep 15 14:32:32.323737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 663/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:32 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:33.345798 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:33.346409 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:33.352452 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:33.352918 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:33.353340 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:33.354113 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:33.354563 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:33.354977 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:33.489741 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:33.498845 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-c4de25ce-a8dc-4108-891f-44c893b0c6f2 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.156834 Sep 15 14:32:33.499433 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 644/1307] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:33 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:34.522371 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:34.523002 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:34.525672 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell0:SELECT=2 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:34.532008 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:34.532481 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:34.532915 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:34.533590 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:34.534035 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:34.534451 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:34.667743 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:34.675547 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f8648103-448c-4dfe-a89c-0eb748f031d7 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.157058 Sep 15 14:32:34.676129 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 664/1308] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:34 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:35.698827 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:35.699719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:35.701731 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=2 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:35.702389 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell0:SELECT=6 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:32:35.708992 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:35.709481 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:35.709921 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:35.710620 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:35.711073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:35.711499 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:35.846702 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:35.855244 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-de9614e6-a6a1-4090-a89f-3f2f79df4c53 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.160686 Sep 15 14:32:35.855842 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 645/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:35 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:36.877924 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:36.878511 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:36.884869 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:36.885417 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:36.885848 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:36.886529 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:36.886974 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:36.887392 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:37.017436 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:37.025075 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-6d17dc1c-3ae8-4de2-a0a5-5d3e437f56fc tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.151058 Sep 15 14:32:37.025646 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 665/1310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:36 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:37.631883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddde029b-85d9-4ae1-95d1-8c1bb06719bb", "name": "network-vif-plugged", "status": "completed", "tag": "766b2b63-af50-42c4-95de-01425c109bb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:32:37.643453 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:37.643954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:37.644385 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:37.655997 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] Creating event network-vif-plugged:766b2b63-af50-42c4-95de-01425c109bb1 for instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb on hv-cinder-85697 Sep 15 14:32:37.661123 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-14377bac-0012-436d-adbf-7f3866760d09 req-b5936aa6-2094-4f10-8e08-80005e7b6574 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093483 Sep 15 14:32:37.661719 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 646/1311] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:32:38.048667 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:38.049314 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:38.055714 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:38.056209 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:38.056653 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:38.058054 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:38.058514 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:38.058942 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:38.187776 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:38.195367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-b4fe5d31-8b37-47f6-b262-ebfec0a7304d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.150612 Sep 15 14:32:38.196360 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 666/1312] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:38 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:39.218001 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:39.218708 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:39.225434 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:39.225915 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:39.226355 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:39.227045 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:39.227501 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:39.227948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:39.358954 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:39.366533 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-473949ea-9310-494f-86b1-aa212ca3ec0d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1266 microversion: 2.1 time: 0.152922 Sep 15 14:32:39.367105 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 647/1313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:39 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:40.389934 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:40.390539 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:40.396940 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:40.397420 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:40.397851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:40.398534 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:40.398983 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:40.399404 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:40.531018 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:40.538693 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-f90388a0-c730-41b3-b616-614e941c297c tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1453 microversion: 2.1 time: 0.152694 Sep 15 14:32:40.539257 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 667/1314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:40 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:40.560889 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:32:40.561507 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:32:40.567900 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:40.568319 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:40.568749 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:40.569436 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:40.569883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:40.570300 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:40.704904 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:32:40.712618 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-23efd14b-529c-4baa-9f79-6aa9a86e4299 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1453 microversion: 2.1 time: 0.155656 Sep 15 14:32:40.713203 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 648/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:32:40 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:32:42.596763 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddde029b-85d9-4ae1-95d1-8c1bb06719bb", "tag": "766b2b63-af50-42c4-95de-01425c109bb1"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:32:42.606823 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:32:42.607301 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:32:42.607761 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:32:42.618602 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] Creating event network-changed:766b2b63-af50-42c4-95de-01425c109bb1 for instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb on hv-cinder-85697 Sep 15 14:32:42.623702 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-6fe64855-dbe0-4dc5-b740-2f0292a88e1e req-ad6ffc52-a49b-4f60-be7a-e155228f2392 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090133 Sep 15 14:32:42.624342 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 668/1316] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:34:32.243575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:34:32.245458 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG dbcounter [-] [120648] Writing DB stats nova_cell1:SELECT=48 {{(pid=120648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:34:32.246750 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:34:32.247078 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Thu Sep 15 14:34:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb (ip 10.222.0.27) !!! Sep 15 14:34:32.247563 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8f10bed-fb40-4a1c-bd1f-c180bf9051a7] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 15 14:34:32.248531 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_api:SELECT=22 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:34:32.249335 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG dbcounter [-] [120647] Writing DB stats nova_cell1:SELECT=50 {{(pid=120647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 14:34:32.250687 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 14:34:32.251107 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Thu Sep 15 14:34:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Sep 15 14:34:32.251669 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:32.252200 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:32.258594 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddde029b-85d9-4ae1-95d1-8c1bb06719bb", "tag": "766b2b63-af50-42c4-95de-01425c109bb1"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:34:32.261332 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:32.262241 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:32.262680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:32.263386 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:32.263883 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:32.264467 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:32.273832 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:32.274316 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:32.274747 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:32.288710 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] Creating event network-changed:766b2b63-af50-42c4-95de-01425c109bb1 for instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb on hv-cinder-85697 Sep 15 14:34:32.292626 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:34:32.294800 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-53908a99-babd-4057-944d-2932ce2850f5 req-1de779e7-a41c-4597-b533-1eec11d8c2d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050943 Sep 15 14:34:32.295738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 669/1317] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:34:32.388047 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-3d34038e-fdbd-4098-a840-98e514dc6cf8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 204 len: 0 microversion: 2.1 time: 0.146132 Sep 15 14:34:32.389195 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 649/1318] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:34:32 2022] DELETE /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:34:32.398162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:32.398870 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:32.406105 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:32.406596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:32.407033 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:32.407807 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:32.408265 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:32.408688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:32.544352 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:32.552011 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-fd235f80-66ef-4757-ace3-52fb80f42528 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1576 microversion: 2.1 time: 0.158044 Sep 15 14:34:32.552576 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 670/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:32 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:34:33.575599 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:33.576605 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:33.583102 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:33.583583 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:33.584055 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:33.584747 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:33.585201 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:33.585621 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:33.722687 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:33.731387 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-9d316844-2f5c-44d4-aacc-1a6e73656e57 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1576 microversion: 2.1 time: 0.160022 Sep 15 14:34:33.732023 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 650/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:33 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:34:34.754691 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:34.755358 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:34.767999 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8f10bed-fb40-4a1c-bd1f-c180bf9051a7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47148. Sep 15 14:34:34.772361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:34.772850 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:34.773289 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:34.774463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:34.775097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:34.775624 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:34.841616 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddde029b-85d9-4ae1-95d1-8c1bb06719bb", "name": "network-vif-deleted", "tag": "766b2b63-af50-42c4-95de-01425c109bb1"}]} {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:34:34.851031 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:34.851502 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:34.851948 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:34.857382 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:34.865601 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.compute.server_external_events [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] Creating event network-vif-deleted:766b2b63-af50-42c4-95de-01425c109bb1 for instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb on hv-cinder-85697 Sep 15 14:34:34.866506 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-e824f313-b9fb-445e-884b-297c58af6a94 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 200 len: 1391 microversion: 2.1 time: 0.115929 Sep 15 14:34:34.867374 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 671/1321] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:34 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 1391 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:34:34.871189 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [req-2a1195d9-2f3c-4c90-9e2d-fbc5560ecbda req-a06ad2a6-5223-478b-b20a-a69ca10f144a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093021 Sep 15 14:34:34.871953 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 651/1322] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:34:35.889272 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:35.889882 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: ddde029b-85d9-4ae1-95d1-8c1bb06719bb] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:35.896280 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:35.896760 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:35.897195 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:35.897912 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:35.898367 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:35.898788 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:35.912422 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] HTTP exception thrown: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Request method failure captured: Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb HTTP/1.1 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzYyt-2j9415Dj248Yga2YEipkjolL1lHeNmJBwzo-7JBr4MElaIyTjUpSvG7whkJ4O1NgKWC6EOe9mvItuQdGGkMxFh_QQaYSXYKAvjvCTAAA5fMn-o_lY5pyhAFEz74hDkJoGzIeK2RgKvXDP-8t_Odum2a_0bVHLrghSBenQX8VQ Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:34:35.914080 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}] Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 1c072306d6534925b92fbc5ef01aaaf6 Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. Sep 15 14:34:35.915914 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'ddde029b-85d9-4ae1-95d1-8c1bb06719bb'} Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:34:35.917413 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. Sep 15 14:34:35.919214 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:35.921049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Returning 404 to user: Instance ddde029b-85d9-4ae1-95d1-8c1bb06719bb could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:34:35.921049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-eab6d645-fcfb-47e8-addd-ab37573d7ae5 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb" status: 404 len: 111 microversion: 2.1 time: 0.030009 Sep 15 14:34:35.921049 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 672/1323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:35 2022] GET /compute/v2.1/servers/ddde029b-85d9-4ae1-95d1-8c1bb06719bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:34:38.960182 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:38.960757 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:38.965185 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6", "tag": "bce75eed-7428-4e92-b341-d6461658fadf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:34:38.968373 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:38.968854 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:38.969283 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:38.969967 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:38.970640 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:38.971058 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:38.976405 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:38.977168 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:38.977596 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:38.990775 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] Creating event network-changed:bce75eed-7428-4e92-b341-d6461658fadf for instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 on hv-cinder-85697 Sep 15 14:34:38.996712 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-03e99df0-e5fa-4bf5-b29a-a2192398b7f5 req-fe956cc7-390c-45ca-a6a2-05a5b62cc264 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036721 Sep 15 14:34:38.997593 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 673/1324] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:34:38.997898 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Going to try to terminate instance {{(pid=120648) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 14:34:39.080460 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-d943025a-06c7-4c42-a140-73ce47c74f2d tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 204 len: 0 microversion: 2.1 time: 0.123751 Sep 15 14:34:39.081380 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 652/1325] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:34:38 2022] DELETE /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 14:34:39.091675 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:39.092494 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:39.099165 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:39.099645 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:39.100141 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:39.100851 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:39.101306 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:39.101737 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:39.236660 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.policy [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:39.244295 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-a1aa9527-afbb-44eb-b976-b75d5e69f005 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1578 microversion: 2.1 time: 0.157512 Sep 15 14:34:39.244862 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 674/1326] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:39 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 14:34:40.268082 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:40.268789 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:40.275073 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:40.275553 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:40.276018 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:40.277227 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:40.277680 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:40.278100 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:40.416855 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:40.425634 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-14700dc0-393b-4382-8893-8414a40b7a63 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1578 microversion: 2.1 time: 0.161781 Sep 15 14:34:40.426376 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 653/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:40 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:34:41.412644 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6", "name": "network-vif-deleted", "tag": "bce75eed-7428-4e92-b341-d6461658fadf"}]} {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 14:34:41.422886 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:41.423361 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:41.423819 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:41.435632 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.compute.server_external_events [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] Creating event network-vif-deleted:bce75eed-7428-4e92-b341-d6461658fadf for instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 on hv-cinder-85697 Sep 15 14:34:41.440650 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [req-3fde7e50-b2aa-4309-b5fb-b88539076324 req-13fb4678-85a9-4bd6-9e2d-1c2628b3ab58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Sep 15 14:34:41.441162 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 675/1328] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 15 14:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 14:34:41.449711 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:41.450334 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:41.457003 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:41.457489 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:41.457932 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:41.458625 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:41.459080 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:41.459504 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:41.523445 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.policy [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c072306d6534925b92fbc5ef01aaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f4deb43acf410aa0a8e88c20ddb3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120648) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 14:34:41.531655 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-4ac8bd90-c2fe-4f6a-9588-ff9eebd09558 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 200 len: 1225 microversion: 2.1 time: 0.086042 Sep 15 14:34:41.532275 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 654/1329] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:41 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 14:34:42.555536 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:42.556270 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:42.562512 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:42.562997 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:42.563437 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:42.564163 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:42.564626 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:42.565051 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:42.578435 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] HTTP exception thrown: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Request method failure captured: Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 HTTP/1.1 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzYyt-2j9415Dj248Yga2YEipkjolL1lHeNmJBwzo-7JBr4MElaIyTjUpSvG7whkJ4O1NgKWC6EOe9mvItuQdGGkMxFh_QQaYSXYKAvjvCTAAA5fMn-o_lY5pyhAFEz74hDkJoGzIeK2RgKvXDP-8t_Odum2a_0bVHLrghSBenQX8VQ Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:34:42.580097 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}] Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 1c072306d6534925b92fbc5ef01aaaf6 Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. Sep 15 14:34:42.581833 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': 'a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6'} Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:34:42.582738 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. Sep 15 14:34:42.584143 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:42.585430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Returning 404 to user: Instance a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:34:42.585430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-d24ff4f6-ede9-41e3-b984-581e92d66b90 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6" status: 404 len: 111 microversion: 2.1 time: 0.030755 Sep 15 14:34:42.585430 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 676/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:42 2022] GET /compute/v2.1/servers/a49b7dfe-e56c-47bf-893d-ea8c8fc4eac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:34:43.012285 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:43.012837 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.compute.api [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120648) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:43.019312 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:43.019814 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:43.020245 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:43.020923 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:43.021368 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:43.021790 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG oslo_concurrency.lockutils [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:43.035714 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.wsgi [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] HTTP exception thrown: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Request method failure captured: Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: request: DELETE /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 HTTP/1.1 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept: application/json Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Accept-Encoding: identity Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Connection: close Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Length: 0 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Content-Type: application/json Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Host: 10.222.0.27 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: Openstack-System-Scope: None Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: User-Agent: python-urllib3/1.26.12 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Auth-Token: gAAAAABjIzYyt-2j9415Dj248Yga2YEipkjolL1lHeNmJBwzo-7JBr4MElaIyTjUpSvG7whkJ4O1NgKWC6EOe9mvItuQdGGkMxFh_QQaYSXYKAvjvCTAAA5fMn-o_lY5pyhAFEz74hDkJoGzIeK2RgKvXDP-8t_Odum2a_0bVHLrghSBenQX8VQ Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Id: None Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Domain-Name: None Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Identity-Status: Confirmed Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Is-Admin-Project: True Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Id: default Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Domain-Name: Default Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Project-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Role: member,reader Sep 15 14:34:43.037343 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Roles: member,reader Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}] Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Id: default Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Domain-Name: Default Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Id: 1c072306d6534925b92fbc5ef01aaaf6 Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: X-User-Name: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: method: > Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: exception: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.039039 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: action_args: {'id': '6afa929a-8671-4b84-a300-dee26b8dfa02'} Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:34:43.040152 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.041771 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.043575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Returning 404 to user: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. {{(pid=120648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:34:43.043575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-813004e8-a73d-4c29-9e52-b8a37b66b732 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 404 len: 111 microversion: 2.1 time: 0.031369 Sep 15 14:34:43.043575 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 655/1331] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 15 14:34:43 2022] DELETE /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:34:43.047463 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '>' {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:43.048102 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.compute.api [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] [instance: 6afa929a-8671-4b84-a300-dee26b8dfa02] Fetching instance by UUID {{(pid=120647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 14:34:43.053955 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:43.054432 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:43.054867 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:43.055565 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Acquiring lock "420e8343-b5ad-47f2-88fe-eb0072589000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 14:34:43.056029 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 14:34:43.056452 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG oslo_concurrency.lockutils [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Lock "420e8343-b5ad-47f2-88fe-eb0072589000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 14:34:43.069427 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.wsgi [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] HTTP exception thrown: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Request method failure captured: Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: request: GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 HTTP/1.1 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept: application/json Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Accept-Encoding: identity Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Connection: close Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Length: 0 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Content-Type: application/json Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Host: 10.222.0.27 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: Openstack-System-Scope: None Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: User-Agent: python-urllib3/1.26.12 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Auth-Token: gAAAAABjIzYyt-2j9415Dj248Yga2YEipkjolL1lHeNmJBwzo-7JBr4MElaIyTjUpSvG7whkJ4O1NgKWC6EOe9mvItuQdGGkMxFh_QQaYSXYKAvjvCTAAA5fMn-o_lY5pyhAFEz74hDkJoGzIeK2RgKvXDP-8t_Odum2a_0bVHLrghSBenQX8VQ Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Id: None Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Domain-Name: None Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Identity-Status: Confirmed Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Is-Admin-Project: True Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Id: default Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Domain-Name: Default Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Project-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Role: member,reader Sep 15 14:34:43.070909 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Roles: member,reader Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9f4deb43acf410aa0a8e88c20ddb3f5"}]}] Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Id: b9f4deb43acf410aa0a8e88c20ddb3f5 Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830130872 Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Id: default Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Domain-Name: Default Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Id: 1c072306d6534925b92fbc5ef01aaaf6 Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: X-User-Name: tempest-TestVolumeBootPattern-1830130872-project Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: method: > Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: exception: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.072688 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: action_args: {'id': '6afa929a-8671-4b84-a300-dee26b8dfa02'} Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: {{(pid=120647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 14:34:43.074517 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. Sep 15 14:34:43.076464 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: ERROR nova.api.openstack.wsgi Sep 15 14:34:43.078173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: DEBUG nova.api.openstack.wsgi [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Returning 404 to user: Instance 6afa929a-8671-4b84-a300-dee26b8dfa02 could not be found. {{(pid=120647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 14:34:43.078173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: INFO nova.api.openstack.requestlog [None req-0a51f87a-05b6-4b1a-b685-f18e9c009181 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02" status: 404 len: 111 microversion: 2.1 time: 0.028656 Sep 15 14:34:43.078173 dv-cinder-856971-2-iscsi devstack@n-api.service[120647]: [pid: 120647|app: 0|req: 677/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 15 14:34:43 2022] GET /compute/v2.1/servers/6afa929a-8671-4b84-a300-dee26b8dfa02 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 14:34:44.365552 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: DEBUG nova.api.openstack.wsgi [None req-8c19a9b1-30ea-444a-b339-d086f6aa02b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] Calling method '.version_select at 0x7fab47c9f3a0>' {{(pid=120648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 14:34:44.388531 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: INFO nova.api.openstack.requestlog [None req-8c19a9b1-30ea-444a-b339-d086f6aa02b8 tempest-TestVolumeBootPattern-1830130872 tempest-TestVolumeBootPattern-1830130872-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-723296571" status: 202 len: 0 microversion: 2.1 time: 0.026858 Sep 15 14:34:44.389144 dv-cinder-856971-2-iscsi devstack@n-api.service[120648]: [pid: 120648|app: 0|req: 656/1333] 10.222.0.27 () {58 vars in 1260 bytes} [Thu Sep 15 14:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-723296571 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)